Jul 28 14:18:46 devstack cinder-volume[76561]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 14:18:46 devstack cinder-volume[76561]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 14:18:46 devstack cinder-volume[76561]: we strongly recommend against using it for new projects. Jul 28 14:18:46 devstack cinder-volume[76561]: If you are already using Eventlet, we recommend migrating to a different Jul 28 14:18:46 devstack cinder-volume[76561]: framework. For more detail see Jul 28 14:18:46 devstack cinder-volume[76561]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 14:18:46 devstack cinder-volume[76561]: import eventlet # noqa Jul 28 14:18:48 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:18:48 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:18:48 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:18:49 devstack cinder-volume[76561]: INFO dbcounter [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Registered counter for database cinder Jul 28 14:18:49 devstack cinder-volume[76561]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG dbcounter [-] [76561] Writer thread running {{(pid=76561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.rpc [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.rpc [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.volume.manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Determined volume DB was empty at startup. Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG cinder.volume.manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76561) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.volume.manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 14:18:50 devstack cinder-volume[76561]: WARNING stevedore.named [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 14:18:50 devstack cinder-volume[76561]: WARNING castellan.key_manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:18:50 devstack cinder-volume[76561]: WARNING cinder.keymgr.conf_key_mgr [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG cinder.volume.drivers.lvm [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76561) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG oslo_concurrency.processutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG oslo_concurrency.processutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.410s {{(pid=76561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.rpc [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.rpc [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 28 14:18:50 devstack cinder-volume[76561]: WARNING stevedore.named [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 14:18:50 devstack cinder-volume[76561]: WARNING castellan.key_manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:18:50 devstack cinder-volume[76561]: INFO cinder.volume.manager [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 28 14:18:50 devstack cinder-volume[76561]: DEBUG oslo_db.sqlalchemy.engines [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:18:51 devstack cinder-volume[76561]: INFO oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Starting 1 workers Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Started child 76705 {{(pid=76561) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Full set of CONF: {{(pid=76561) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] ******************************************************************************** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Configuration options gathered from: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] ================================================================================ {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] allow_availability_zone_fallback = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] allow_compression_on_image_upload = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] allowed_direct_url_schemes = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] api_rate_limit = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] auth_strategy = keystone {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] az_cache_duration = 3600 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_availability_zone = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_host = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_stats_polling_interval = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backup_api_class = cinder.backup.api.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backup_name_template = backup-%s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backup_use_same_host = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backup_use_temp_snapshot = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] chap_password = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] chap_username = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_internal_tenant_project_id = cb25158e14454fd498f7e3f3ad413df8 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_internal_tenant_user_id = b17f4e55990c4adb81b32da6db4caf0b {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cloned_volume_same_az = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cluster = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] compression_format = gzip {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] config_dir = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] config_source = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] control_exchange = openstack {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] debug = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] default_availability_zone = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] default_group_type = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] default_volume_type = lvmdriver-1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] disk_geometry = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_client_cert = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_client_cert_key = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_data_namespace = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_ssl_cert_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_ssl_cert_verify = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] driver_use_ssl = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] enable_force_upload = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] enable_new_services = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] enable_unsupported_driver = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] enforce_multipath_for_image_xfer = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] filter_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_api_insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_api_ssl_compression = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_ca_certificates_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_num_retries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance_request_timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] goodness_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] graceful_shutdown_timeout = 5 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] group_api_class = cinder.group.api.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] host = devstack {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_compress_on_upload = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_conversion_address_space_limit = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_conversion_cpu_limit = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_conversion_disable = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_upload_use_cinder_backend = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_upload_use_internal_tenant = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_volume_cache_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_volume_cache_max_count = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] init_host_max_objects_retrieval = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] instance_format = [instance: %(uuid)s] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iscsi_target_flags = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iscsi_write_cache = on {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iser_helper = tgtadm {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iser_ip_address = 192.168.122.13 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iser_port = 3260 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_color = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_config_append = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: INFO cinder.volume.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_dir = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_options = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_rotate_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_rotate_interval_type = days {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] log_rotation_type = none {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] max_age = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] max_logfile_count = 30 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] max_logfile_size_mb = 200 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] max_over_subscription_ratio = 20.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] message_reap_interval = 86400 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] message_ttl = 2592000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] monkey_patch = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] monkey_patch_modules = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] my_ip = 192.168.122.13 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] no_snapshot_gb_quota = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] num_iser_scan_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] num_shell_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] num_volume_device_scan_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] nvmeof_conn_info_version = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] nvmet_ns_id = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] nvmet_port_id = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_max_limit = 1000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_ext_list = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_listen_port = 8776 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_use_ssl = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] osapi_volume_workers = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] per_volume_size_limit = -1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] periodic_fuzzy_delay = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] periodic_interval = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] public_endpoint = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] publish_errors = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_backup_gigabytes = 1000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_backups = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_gigabytes = 1000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_groups = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_snapshots = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] quota_volumes = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] rate_limit_burst = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] rate_limit_except_level = CRITICAL {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] rate_limit_interval = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] reinit_driver_count = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] replication_device = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] report_discard_supported = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] report_interval = 120 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] reservation_clean_interval = 86400 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] reservation_expire = 86400 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] reserved_image_namespaces = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] reserved_percentage = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] rpc_response_timeout = 120 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] run_external_periodic_tasks = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] scst_target_driver = iscsi {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] scst_target_iqn_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_down_time = 720 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] shell_completion = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] snapshot_name_template = snapshot-%s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] snapshot_same_host = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] split_loggers = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] state_path = /opt/stack/data/cinder {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] storage_availability_zone = nova {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] storage_protocol = iSCSI {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] syslog_log_facility = LOG_USER {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_helper = lioadm {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_ip_address = 192.168.122.13 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_port = 3260 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_protocol = iscsi {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] target_secondary_ip_addresses = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] trace_flags = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] transport_url = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] until_refresh = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_chap_auth = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_default_quota_class = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_journal = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_json = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_multipath_for_image_xfer = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_stderr = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] use_syslog = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] verify_glance_signatures = enabled {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_api_class = cinder.volume.api.API {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_backend_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_clear = zero {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_clear_ionice = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_clear_size = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_copy_bps_limit = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_dd_blocksize = 1M {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_name_template = volume-%s {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_service_inithost_offload = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volume_usage_audit_period = month {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] zoning_mode = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.auth_section = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.auth_type = password {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.auth_version = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.cache = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.interface = public {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_password = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcache_username = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.region_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.service_type = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.backend = dogpile.cache.null {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.backend_argument = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.backend_expiration_time = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.config_prefix = cache.oslo {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.debug_cache_backend = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.enable_retry_client = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.enable_socket_keepalive = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.expiration_time = 600 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_dead_retry = 300 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_sasl_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.password = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.proxies = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.redis_db = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.redis_server = localhost:6379 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.retry_attempts = 2 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.retry_delay = 0.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.socket_keepalive_count = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.socket_keepalive_idle = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.socket_keepalive_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.socket_timeout = 1.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.tls_allowed_ciphers = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.tls_cafile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.tls_certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.tls_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.tls_keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cache.username = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] coordination.backend_url = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.asyncio_connection = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.asyncio_slave_connection = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.backend = sqlalchemy {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack sudo[76710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 28 14:18:51 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.connection = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.connection_debug = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.connection_parameters = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.connection_recycle_time = 3600 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.connection_trace = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.db_inc_retry_interval = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.db_max_retries = 20 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.db_max_retry_interval = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.db_retry_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.max_overflow = 50 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.max_pool_size = 5 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.max_retries = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.pool_timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.retry_interval = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.slave_connection = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.sqlite_synchronous = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.synchronous_reader = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] database.use_db_reconnect = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.connection_string = messaging:// {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.es_doc_type = notification {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.es_scroll_size = 10000 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.es_scroll_time = 2m {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.filter_error_trace = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.hmac_keys = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.sentinel_service_name = mymaster {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.socket_timeout = 0.1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.trace_requests = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler.trace_sqlalchemy = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler_jaeger.process_tags = {} {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] profiler_otlp.service_name_prefix = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.policy_default_rule = default {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.group = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.helper_command = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] privsep_osbrick.user = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.group = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.helper_command = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] cinder_sys_admin.user = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.auth_section = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.auth_type = password {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.cafile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.collect_timing = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.send_service_user_token = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.split_loggers = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] service_user.timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.auth_section = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.auth_type = password {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.collect_timing = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.region_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.split_loggers = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] glance.timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.backend_availability_zone = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.chap_password = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.chap_username = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.disk_geometry = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_client_cert = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_data_namespace = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.driver_use_ssl = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.extra_capabilities = {} {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.filter_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.goodness_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iscsi_target_flags = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iser_port = 3260 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.lvm_share_target = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.lvm_type = auto {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.replication_device = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.report_discard_supported = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_helper = tgtadm {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_port = 3260 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_protocol = iscsi {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.trace_flags = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.use_chap_auth = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_backend_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_clear = zero {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_reports.file_event_handler = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_reports.log_dir = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.backend_host = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.chap_password = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.chap_username = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.disk_geometry = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_client_cert = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.extra_capabilities = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.filter_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.goodness_function = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iser_helper = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iser_ip_address = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iser_port = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.lvm_share_target = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.lvm_type = auto {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.num_shell_tries = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.replication_device = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.report_discard_supported = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.reserved_percentage = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.scst_target_driver = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.storage_protocol = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_helper = lioadm {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_ip_address = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_port = 3260 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.trace_flags = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.use_chap_auth = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_clear = zero {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_clear_size = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] lvmdriver-1.volumes_dir = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_notifications.driver = [] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] key_manager.fixed_key = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.barbican_api_version = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.barbican_endpoint = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.barbican_endpoint_type = public {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.barbican_region_name = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.cafile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.collect_timing = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.number_of_retries = 60 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.retry_delay = 1 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.send_service_user_token = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.split_loggers = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.verify_ssl = True {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican.verify_ssl_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.auth_section = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.auth_type = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.cafile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.certfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.collect_timing = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.insecure = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.keyfile = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.split_loggers = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] barbican_service_user.timeout = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.approle_role_id = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.approle_secret_id = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.auth_method = approle {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.auth_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.kv_mountpoint = secret {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.kv_path = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.kv_version = 2 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.namespace = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.root_token_id = **** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.ssl_ca_crt_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.timeout = 60.0 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.token_file = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.token_role = None {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.use_ssl = False {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:18:51 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] ******************************************************************************** {{(pid=76561) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 14:18:51 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:51 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:51 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:51 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:52 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.458s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:18:52 devstack cinder-volume[76705]: INFO cinder.brick.local_dev.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:52 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:52 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:52 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG cinder.brick.local_dev.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76705) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:52 devstack sudo[76957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:52 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:52 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:52 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:52 devstack sudo[77150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:52 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:53 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:53 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 28 14:18:53 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:53 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:53 devstack sudo[77336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:53 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:53 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:53 devstack sudo[77362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:53 devstack sudo[77362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:53 devstack sudo[77362]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:53 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack sudo[77435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:54 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:54 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack sudo[77448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:54 devstack sudo[77448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:54 devstack sudo[77448]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack sudo[77475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:54 devstack sudo[77475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:54 devstack sudo[77475]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.349s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:54 devstack cinder-volume[76705]: INFO cinder.volume.drivers.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:54 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:54 devstack sudo[77543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:54 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:55 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:55 devstack sudo[77546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:55 devstack sudo[77546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:55 devstack sudo[77546]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:55 devstack sudo[77555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:55 devstack sudo[77555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:55 devstack sudo[77555]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:55 devstack sudo[77558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:55 devstack sudo[77558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:55 devstack sudo[77558]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:55 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:55 devstack sudo[77561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:55 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:56 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:56 devstack cinder-volume[76705]: INFO cinder.volume.driver [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG cinder.volume.driver [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76705) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_db.sqlalchemy.engines [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writer thread running {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG cinder.db.api [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Building query based on filter {{(pid=76705) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG cinder.image.image_utils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76705) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 14:18:56 devstack cinder-volume[76705]: INFO cinder.keymgr.migration [None req-15f07cfb-5047-4282-8c4f-f3d835f73862 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:56 devstack sudo[77565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:56 devstack sudo[77565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:56 devstack sudo[77565]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:56 devstack sudo[77568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:56 devstack sudo[77568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:56 devstack sudo[77568]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:56 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:56 devstack sudo[77573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:56 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:57 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:57 devstack sudo[77577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:57 devstack sudo[77577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:57 devstack sudo[77577]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG cinder.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Notifying Schedulers of capabilities ... {{(pid=76705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:18:57 devstack cinder-volume[76705]: INFO cinder.volume.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Driver initialization completed successfully. Jul 28 14:18:57 devstack cinder-volume[76705]: INFO cinder.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Initiating service 2 cleanup Jul 28 14:18:57 devstack cinder-volume[76705]: INFO cinder.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Service 2 cleanup completed. Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG cinder.service [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Creating RPC server for service cinder-volume {{(pid=76705) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG cinder.service [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76705) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 14:18:57 devstack cinder-volume[76705]: INFO cinder.volume.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:57 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:18:57 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:57 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:57 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:57 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:57 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:58 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:58 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:58 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:58 devstack sudo[77588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:18:58 devstack sudo[77588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:58 devstack sudo[77588]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:58 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:58 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:18:58 devstack sudo[77591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:18:58 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:18:58 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root Jul 28 14:18:58 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:18:58 devstack cinder-volume[76705]: INFO cinder.volume.manager [None req-1469212e-c613-4882-8795-46f7b1b0b1e8 None None] Driver post RPC initialization completed successfully. Jul 28 14:19:01 devstack cinder-volume[76561]: DEBUG dbcounter [-] [76561] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:19:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:19:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:19:30 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager._thread_info {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:19:30 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread count: 6 {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:19:30 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread info: [<_MainThread(MainThread, started 129448268832896)>, , , , , ] {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:20:30 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:20:30 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:20:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:20:30 devstack sudo[80243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:20:30 devstack sudo[80243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:20:30 devstack sudo[80243]: pam_unix(sudo:session): session closed for user root Jul 28 14:20:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:20:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:20:30 devstack sudo[80246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:20:30 devstack sudo[80246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:20:31 devstack sudo[80246]: pam_unix(sudo:session): session closed for user root Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:20:31 devstack sudo[80249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:20:31 devstack sudo[80249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:20:31 devstack sudo[80249]: pam_unix(sudo:session): session closed for user root Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:20:31 devstack sudo[80252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:20:31 devstack sudo[80252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:20:31 devstack sudo[80252]: pam_unix(sudo:session): session closed for user root Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG cinder.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Notifying Schedulers of capabilities ... {{(pid=76705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager._thread_info {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread count: 6 {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:20:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread info: [<_MainThread(MainThread, started 129448268832896)>, , , , , ] {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:21:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:SELECT=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:21:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:UPDATE=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:21:30 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:21:30 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:21:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:21:30 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:21:30 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:21:30 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Jul 28 14:21:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:21:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:21:30 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:21:30 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:21:31 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:21:31 devstack sudo[83976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:21:31 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:21:31 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:21:31 devstack sudo[83997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:21:31 devstack sudo[83997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:21:31 devstack sudo[83997]: pam_unix(sudo:session): session closed for user root Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG cinder.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Notifying Schedulers of capabilities ... {{(pid=76705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager._thread_info {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread count: 6 {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:21:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread info: [<_MainThread(MainThread, started 129448268832896)>, , , , , ] {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:22:30 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:22:30 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:22:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:22:30 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:22:30 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:22:30 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Jul 28 14:22:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:22:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:22:30 devstack sudo[85599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:22:30 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:22:31 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:22:31 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:22:31 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:22:31 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:22:31 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:22:31 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:22:31 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:22:31 devstack cinder-volume[76705]: DEBUG cinder.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Notifying Schedulers of capabilities ... {{(pid=76705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:23:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:SELECT=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:23:08 devstack cinder-volume[76705]: DEBUG dbcounter [-] [76705] Writing DB stats cinder:UPDATE=1 {{(pid=76705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:23:24 devstack cinder-volume[76561]: INFO oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Caught SIGTERM, stopping children Jul 28 14:23:24 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Acquiring lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:24 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Acquired lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:24 devstack cinder-volume[76561]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Releasing lock "singleton_lock" {{(pid=76561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:24 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Stop services. {{(pid=76561) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 14:23:24 devstack cinder-volume[76561]: DEBUG oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Killing children. {{(pid=76561) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 14:23:24 devstack cinder-volume[76561]: INFO oslo_service.backend._eventlet.service [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Waiting on 1 children to exit Jul 28 14:23:29 devstack cinder-volume[76705]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 28 14:23:29 devstack cinder-volume[86845]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 14:23:29 devstack cinder-volume[86845]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 14:23:29 devstack cinder-volume[86845]: we strongly recommend against using it for new projects. Jul 28 14:23:29 devstack cinder-volume[86845]: If you are already using Eventlet, we recommend migrating to a different Jul 28 14:23:29 devstack cinder-volume[86845]: framework. For more detail see Jul 28 14:23:29 devstack cinder-volume[86845]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 14:23:29 devstack cinder-volume[86845]: import eventlet # noqa Jul 28 14:23:30 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:23:30 devstack cinder-volume[76705]: DEBUG cinder.volume.drivers.lvm [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Updating volume stats {{(pid=76705) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 28 14:23:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:30 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 28 14:23:30 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:30 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:30 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:31 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:23:31 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:31 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:31 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 28 14:23:31 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:31 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:31 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 28 14:23:31 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:31 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_concurrency.processutils [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76705) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG cinder.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Notifying Schedulers of capabilities ... {{(pid=76705) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG oslo_service.periodic_task [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] Running periodic task VolumeManager._thread_info {{(pid=76705) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread count: 6 {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:23:31 devstack cinder-volume[76705]: DEBUG cinder.volume.manager [None req-5ddc5b8e-7c74-4c01-80ca-844649092569 None None] thread info: [<_MainThread(MainThread, started 129448268832896)>, , , , , ] {{(pid=76705) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:23:31 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:31 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:31 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:32 devstack cinder-volume[86845]: INFO dbcounter [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Registered counter for database cinder Jul 28 14:23:32 devstack cinder-volume[76705]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Acquiring lock "singleton_lock" {{(pid=76705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:32 devstack cinder-volume[76705]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Acquired lock "singleton_lock" {{(pid=76705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:32 devstack cinder-volume[76705]: DEBUG oslo_concurrency.lockutils [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Releasing lock "singleton_lock" {{(pid=76705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:32 devstack cinder-volume[76705]: WARNING amqp [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 14:23:32 devstack cinder-volume[76705]: WARNING amqp [None req-0d3c76e7-4ccf-49f8-8304-8e347422f1a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 14:23:32 devstack cinder-volume[86845]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG dbcounter [-] [86845] Writer thread running {{(pid=86845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:23:33 devstack cinder-volume[86845]: INFO cinder.rpc [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 14:23:33 devstack cinder-volume[86845]: INFO cinder.rpc [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:33 devstack cinder-volume[86845]: INFO cinder.volume.manager [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Determined volume DB was empty at startup. Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG cinder.volume.manager [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86845) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 14:23:33 devstack cinder-volume[86845]: INFO cinder.volume.manager [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 28 14:23:33 devstack cinder-volume[86845]: WARNING stevedore.named [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 14:23:33 devstack cinder-volume[86845]: WARNING castellan.key_manager [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:23:33 devstack cinder-volume[86845]: WARNING cinder.keymgr.conf_key_mgr [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:23:33 devstack cinder-volume[86845]: INFO cinder.volume.manager [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_db.sqlalchemy.engines [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:33 devstack cinder-volume[86845]: INFO oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Starting 1 workers Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Started child 87077 {{(pid=86845) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Full set of CONF: {{(pid=86845) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] ******************************************************************************** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Configuration options gathered from: {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] ================================================================================ {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] allow_availability_zone_fallback = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] allow_compression_on_image_upload = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] allowed_direct_url_schemes = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] api_rate_limit = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] auth_strategy = keystone {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_availability_zone = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_host = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_stats_polling_interval = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backup_api_class = cinder.backup.api.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backup_name_template = backup-%s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backup_use_same_host = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backup_use_temp_snapshot = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] chap_password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[87077]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] chap_username = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_internal_tenant_project_id = cb25158e14454fd498f7e3f3ad413df8 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_internal_tenant_user_id = b17f4e55990c4adb81b32da6db4caf0b {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cluster = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] compression_format = gzip {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] compute_api_class = cinder.compute.nova.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] config_dir = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] config_source = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] control_exchange = openstack {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] debug = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] default_availability_zone = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] default_group_type = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] default_volume_type = QuobyteHD {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] disk_geometry = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_client_cert = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_client_cert_key = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_data_namespace = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_ssl_cert_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_ssl_cert_verify = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] driver_use_ssl = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] enable_new_services = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] enable_unsupported_driver = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] enabled_backends = ['QuobyteHD'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] enforce_multipath_for_image_xfer = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] filter_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_api_insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_api_ssl_compression = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_ca_certificates_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_catalog_info = image:glance:publicURL {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_num_retries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance_request_timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] goodness_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] graceful_shutdown_timeout = 5 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] group_api_class = cinder.group.api.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] host = devstack {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_compress_on_upload = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_conversion_address_space_limit = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_conversion_cpu_limit = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_conversion_disable = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_upload_use_cinder_backend = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_upload_use_internal_tenant = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_volume_cache_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_volume_cache_max_count = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] image_volume_cache_max_size_gb = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] init_host_max_objects_retrieval = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] instance_format = [instance: %(uuid)s] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iscsi_target_flags = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iscsi_write_cache = on {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iser_helper = tgtadm {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iser_ip_address = 192.168.122.13 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iser_port = 3260 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_color = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_config_append = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_dir = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_options = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_rotate_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_rotate_interval_type = days {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] log_rotation_type = none {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] max_age = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] max_logfile_count = 30 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] max_logfile_size_mb = 200 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] max_over_subscription_ratio = 20.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] message_reap_interval = 86400 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] message_ttl = 2592000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] migration_create_volume_timeout_secs = 300 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] monkey_patch = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] monkey_patch_modules = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] my_ip = 192.168.122.13 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] no_snapshot_gb_quota = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] num_iser_scan_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] num_shell_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] num_volume_device_scan_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] nvmeof_conn_info_version = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] nvmet_ns_id = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] nvmet_port_id = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_max_limit = 1000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_ext_list = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_listen_port = 8776 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_use_ssl = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] osapi_volume_workers = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] per_volume_size_limit = -1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] periodic_fuzzy_delay = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] periodic_interval = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] public_endpoint = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] publish_errors = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_backup_gigabytes = 1000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_backups = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_gigabytes = 1000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_groups = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_snapshots = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] quota_volumes = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] rate_limit_burst = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] rate_limit_except_level = CRITICAL {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] rate_limit_interval = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] reinit_driver_count = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] replication_device = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] report_discard_supported = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] report_interval = 120 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] reservation_clean_interval = 86400 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] reservation_expire = 86400 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] reserved_image_namespaces = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] reserved_percentage = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] rpc_response_timeout = 120 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] run_external_periodic_tasks = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] scst_target_driver = iscsi {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] scst_target_iqn_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_down_time = 720 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] shell_completion = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] snapshot_name_template = snapshot-%s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] split_loggers = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] state_path = /opt/stack/data/cinder {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] storage_availability_zone = nova {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] storage_protocol = iSCSI {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] syslog_log_facility = LOG_USER {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_helper = lioadm {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_ip_address = 192.168.122.13 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_port = 3260 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[87077]: INFO cinder.volume.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Starting volume driver QuobyteDriver (1.2) Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_protocol = iscsi {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] target_secondary_ip_addresses = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] trace_flags = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.remotefs [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87077) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] transport_url = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] until_refresh = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_chap_auth = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_default_quota_class = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_journal = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_json = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_multipath_for_image_xfer = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_stderr = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] use_syslog = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] verify_glance_signatures = enabled {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_api_class = cinder.volume.api.API {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_backend_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_clear = zero {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_clear_ionice = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_clear_size = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_copy_bps_limit = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_dd_blocksize = 1M {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_name_template = volume-%s {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_service_inithost_offload = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volume_usage_audit_period = month {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] zoning_mode = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_concurrency.disable_process_locking = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.auth_section = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.auth_type = password {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.auth_version = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.cache = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.include_service_catalog = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.interface = public {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_password = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcache_username = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.region_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.service_type = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.backend = dogpile.cache.null {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.backend_argument = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.backend_expiration_time = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.config_prefix = cache.oslo {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.debug_cache_backend = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.enable_retry_client = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.enable_socket_keepalive = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.expiration_time = 600 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.hashclient_retry_attempts = 2 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_dead_retry = 300 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_pool_maxsize = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_sasl_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.proxies = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.redis_db = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.redis_server = localhost:6379 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.retry_attempts = 2 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.retry_delay = 0.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.socket_keepalive_count = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.socket_keepalive_idle = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.socket_keepalive_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.socket_timeout = 1.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.tls_allowed_ciphers = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.tls_cafile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.tls_certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.tls_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.tls_keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cache.username = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] coordination.backend_url = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.asyncio_connection = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.asyncio_slave_connection = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.backend = sqlalchemy {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.connection = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.connection_debug = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.connection_parameters = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.connection_recycle_time = 3600 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.connection_trace = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.db_inc_retry_interval = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.db_max_retries = 20 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.db_max_retry_interval = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.db_retry_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.max_overflow = 50 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.max_pool_size = 5 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.max_retries = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.mysql_wsrep_sync_wait = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.pool_timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.retry_interval = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.slave_connection = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.sqlite_synchronous = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.synchronous_reader = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] database.use_db_reconnect = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.connection_string = messaging:// {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.es_doc_type = notification {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.es_scroll_size = 10000 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.es_scroll_time = 2m {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.filter_error_trace = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.hmac_keys = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.sentinel_service_name = mymaster {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.socket_timeout = 0.1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.trace_requests = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler.trace_sqlalchemy = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler_jaeger.process_tags = {} {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler_jaeger.service_name_prefix = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] profiler_otlp.service_name_prefix = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.enforce_new_defaults = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.policy_default_rule = default {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.policy_file = policy.yaml {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.group = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.helper_command = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] privsep_osbrick.user = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.group = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.helper_command = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] cinder_sys_admin.user = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.auth_section = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.auth_type = password {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.cafile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.collect_timing = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.send_service_user_token = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.split_loggers = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] service_user.timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.auth_section = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.auth_type = password {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.collect_timing = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.region_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.split_loggers = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] glance.timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.backend_availability_zone = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.chap_password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.chap_username = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.disk_geometry = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_client_cert = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_client_cert_key = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_data_namespace = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.driver_use_ssl = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.extra_capabilities = {} {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.filter_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.goodness_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iscsi_target_flags = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iscsi_write_cache = on {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iser_helper = tgtadm {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iser_port = 3260 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_host = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_login = admin {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_mount_options = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_private_key = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_share_path = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.num_shell_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.quobyte_volume_url = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.replication_device = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.report_discard_supported = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.reserved_percentage = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87077) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 14:23:33 devstack cinder-volume[87077]: WARNING cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 14:23:33 devstack cinder-volume[87077]: WARNING cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_helper = tgtadm {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_port = 3260 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_protocol = iscsi {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.trace_flags = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.unique_fqdn_network = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.use_chap_auth = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Running cmd (subprocess): mount.quobyte {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_backend_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_clear = zero {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_clear_ionice = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_clear_size = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_reports.file_event_handler = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_reports.log_dir = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.backend_availability_zone = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.backend_host = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.chap_password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.chap_username = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.chiscsi_conf = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.disk_geometry = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_client_cert = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_data_namespace = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.driver_use_ssl = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.extra_capabilities = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.filter_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.goodness_function = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iser_helper = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iser_ip_address = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iser_port = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.iser_target_prefix = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_host = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_login = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_mount_options = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_password = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_private_key = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_share_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_ssh_port = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.num_shell_tries = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.nvmet_port_id = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.replication_device = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.report_discard_supported = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.reserved_percentage = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.scst_target_driver = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.storage_protocol = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_helper = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_ip_address = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_port = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_prefix = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_protocol = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.trace_flags = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.use_chap_auth = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_clear = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_clear_size = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] QuobyteHD.volumes_dir = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_notifications.driver = [] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_notifications.retry = -1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] key_manager.fixed_key = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.barbican_api_version = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.barbican_endpoint = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.barbican_endpoint_type = public {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.barbican_region_name = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.cafile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.collect_timing = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.number_of_retries = 60 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.retry_delay = 1 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.send_service_user_token = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.split_loggers = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.verify_ssl = True {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican.verify_ssl_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.auth_section = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.auth_type = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.cafile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.certfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.collect_timing = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.insecure = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.keyfile = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.split_loggers = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] barbican_service_user.timeout = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.approle_role_id = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.approle_secret_id = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.auth_method = approle {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.auth_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.kv_mountpoint = secret {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.kv_path = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.kv_version = 2 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.namespace = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.root_token_id = **** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.ssl_ca_crt_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.timeout = 60.0 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.token_file = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.token_role = None {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.use_ssl = False {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:33 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] ******************************************************************************** {{(pid=86845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 14:23:33 devstack quobyte-client[87082]: Reading configuration file: /etc/quobyte/client.cfg Jul 28 14:23:33 devstack quobyte-client[87082]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:33 devstack cinder-volume[87077]: INFO cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 ... Jul 28 14:23:33 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 -c /etc/quobyte/client-cinder.cfg {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:33 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 -c /etc/quobyte/client-cinder.cfg Jul 28 14:23:33 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:34 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 succeeded Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.414s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:34 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:34 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:34 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.252s {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.volume.driver [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Driver hasn't implemented _init_vendor_properties() Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.driver [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87077) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_db.sqlalchemy.engines [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG dbcounter [-] [87077] Writer thread running {{(pid=87077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.db.api [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Building query based on filter {{(pid=87077) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.image.image_utils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87077) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.keymgr.migration [None req-074c3ce1-a884-41c4-be60-ad824a17e6bf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:34 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:34 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:34 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.259s {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Notifying Schedulers of capabilities ... {{(pid=87077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.volume.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Driver initialization completed successfully. Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Initiating service 3 cleanup Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Service 3 cleanup completed. Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.service [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Creating RPC server for service cinder-volume {{(pid=87077) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.service [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87077) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 14:23:34 devstack cinder-volume[87077]: INFO cinder.volume.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG cinder.volume.drivers.quobyte [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:34 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:34 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:34 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:35 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:35 devstack cinder-volume[87077]: DEBUG oslo_concurrency.processutils [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.377s {{(pid=87077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:35 devstack cinder-volume[87077]: INFO cinder.volume.manager [None req-fd07943b-ab2a-496c-a6a7-20acdd03554e None None] Driver post RPC initialization completed successfully. Jul 28 14:23:38 devstack cinder-volume[86845]: INFO oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Caught SIGTERM, stopping children Jul 28 14:23:38 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Acquiring lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:38 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Acquired lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:38 devstack cinder-volume[86845]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Releasing lock "singleton_lock" {{(pid=86845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:38 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Stop services. {{(pid=86845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 28 14:23:38 devstack cinder-volume[86845]: DEBUG oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Killing children. {{(pid=86845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 28 14:23:38 devstack cinder-volume[86845]: INFO oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Waiting on 1 children to exit Jul 28 14:23:39 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Acquiring lock "singleton_lock" {{(pid=87077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:39 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Acquired lock "singleton_lock" {{(pid=87077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:39 devstack cinder-volume[87077]: DEBUG oslo_concurrency.lockutils [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Releasing lock "singleton_lock" {{(pid=87077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:39 devstack cinder-volume[87077]: WARNING amqp [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 14:23:39 devstack cinder-volume[87077]: WARNING amqp [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 28 14:23:39 devstack cinder-volume[86845]: INFO oslo_service.backend._eventlet.service [None req-2d6cbbd6-2088-4448-a512-fde9ecf90dbc None None] Child 87077 exited with status 0 Jul 28 14:23:39 devstack cinder-volume[87350]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 28 14:23:39 devstack cinder-volume[87350]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 14:23:39 devstack cinder-volume[87350]: we strongly recommend against using it for new projects. Jul 28 14:23:39 devstack cinder-volume[87350]: If you are already using Eventlet, we recommend migrating to a different Jul 28 14:23:39 devstack cinder-volume[87350]: framework. For more detail see Jul 28 14:23:39 devstack cinder-volume[87350]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 14:23:39 devstack cinder-volume[87350]: import eventlet # noqa Jul 28 14:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 28 14:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 28 14:23:41 devstack cinder-volume[87350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 28 14:23:42 devstack cinder-volume[87350]: INFO dbcounter [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Registered counter for database cinder Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_db.sqlalchemy.engines [None req-31323c48-d573-451c-bf1f-61440334df9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writer thread running {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:23:42 devstack cinder-volume[87350]: INFO cinder.rpc [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 28 14:23:42 devstack cinder-volume[87350]: INFO cinder.rpc [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_db.sqlalchemy.engines [None req-31323c48-d573-451c-bf1f-61440334df9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Determined volume DB was empty at startup. Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG cinder.volume.manager [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87350) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 28 14:23:42 devstack cinder-volume[87350]: WARNING stevedore.named [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 28 14:23:42 devstack cinder-volume[87350]: WARNING castellan.key_manager [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:23:42 devstack cinder-volume[87350]: WARNING cinder.keymgr.conf_key_mgr [None req-31323c48-d573-451c-bf1f-61440334df9e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 28 14:23:42 devstack cinder-volume[87350]: INFO cinder.volume.manager [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_db.sqlalchemy.engines [None req-31323c48-d573-451c-bf1f-61440334df9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:42 devstack cinder-volume[87350]: INFO oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Starting 1 workers Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Started child 87385 {{(pid=87350) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Full set of CONF: {{(pid=87350) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] ******************************************************************************** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] Configuration options gathered from: {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] ================================================================================ {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] allow_availability_zone_fallback = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] allow_compression_on_image_upload = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] allowed_direct_url_schemes = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] api_rate_limit = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] auth_strategy = keystone {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87385]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_availability_zone = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_host = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_stats_polling_interval = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backup_api_class = cinder.backup.api.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backup_name_template = backup-%s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backup_use_same_host = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backup_use_temp_snapshot = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] chap_password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] chap_username = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_internal_tenant_project_id = cb25158e14454fd498f7e3f3ad413df8 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_internal_tenant_user_id = b17f4e55990c4adb81b32da6db4caf0b {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cluster = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] compression_format = gzip {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] compute_api_class = cinder.compute.nova.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] config_dir = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] config_source = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] control_exchange = openstack {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] debug = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] default_availability_zone = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] default_group_type = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] default_volume_type = QuobyteHD {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] disk_geometry = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_client_cert = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_client_cert_key = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_data_namespace = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_ssl_cert_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_ssl_cert_verify = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] driver_use_ssl = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] enable_new_services = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] enable_unsupported_driver = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] enabled_backends = ['QuobyteHD'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] enforce_multipath_for_image_xfer = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] filter_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_api_insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_api_ssl_compression = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_ca_certificates_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_catalog_info = image:glance:publicURL {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_num_retries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance_request_timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] goodness_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] graceful_shutdown_timeout = 5 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] group_api_class = cinder.group.api.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] host = devstack {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:42 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_compress_on_upload = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_conversion_address_space_limit = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_conversion_cpu_limit = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_conversion_disable = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_upload_use_cinder_backend = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_upload_use_internal_tenant = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_volume_cache_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_volume_cache_max_count = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Starting volume driver QuobyteDriver (1.2) Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] image_volume_cache_max_size_gb = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] init_host_max_objects_retrieval = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] instance_format = [instance: %(uuid)s] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87385) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iscsi_target_flags = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iscsi_write_cache = on {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iser_helper = tgtadm {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iser_ip_address = 192.168.122.13 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iser_port = 3260 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_color = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_config_append = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_dir = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_options = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_rotate_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_rotate_interval_type = days {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] log_rotation_type = none {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] max_age = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] max_logfile_count = 30 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] max_logfile_size_mb = 200 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] max_over_subscription_ratio = 20.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] message_reap_interval = 86400 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] message_ttl = 2592000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] migration_create_volume_timeout_secs = 300 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] monkey_patch = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] monkey_patch_modules = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] my_ip = 192.168.122.13 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] no_snapshot_gb_quota = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] num_iser_scan_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] num_shell_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] num_volume_device_scan_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] nvmeof_conn_info_version = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] nvmet_ns_id = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] nvmet_port_id = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_max_limit = 1000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_ext_list = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_listen_port = 8776 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_use_ssl = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] osapi_volume_workers = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] per_volume_size_limit = -1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] periodic_fuzzy_delay = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] periodic_interval = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] public_endpoint = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] publish_errors = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_backup_gigabytes = 1000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_backups = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_gigabytes = 1000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_groups = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_snapshots = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] quota_volumes = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] rate_limit_burst = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] rate_limit_except_level = CRITICAL {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] rate_limit_interval = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] reinit_driver_count = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] replication_device = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] report_discard_supported = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] report_interval = 120 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] reservation_clean_interval = 86400 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] reservation_expire = 86400 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] reserved_image_namespaces = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] reserved_percentage = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] rpc_response_timeout = 120 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] run_external_periodic_tasks = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] scst_target_driver = iscsi {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] scst_target_iqn_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_down_time = 720 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] shell_completion = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] snapshot_name_template = snapshot-%s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] split_loggers = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] state_path = /opt/stack/data/cinder {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] storage_availability_zone = nova {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] storage_protocol = iSCSI {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] syslog_log_facility = LOG_USER {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_helper = lioadm {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_ip_address = 192.168.122.13 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_port = 3260 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_protocol = iscsi {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] target_secondary_ip_addresses = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] trace_flags = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] transport_url = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] until_refresh = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_chap_auth = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_default_quota_class = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_journal = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_json = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_multipath_for_image_xfer = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_stderr = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] use_syslog = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] verify_glance_signatures = enabled {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_api_class = cinder.volume.api.API {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_backend_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_clear = zero {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_clear_ionice = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_clear_size = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_copy_bps_limit = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_dd_blocksize = 1M {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_name_template = volume-%s {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_service_inithost_offload = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volume_usage_audit_period = month {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] zoning_mode = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_concurrency.disable_process_locking = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.auth_section = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.auth_type = password {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.auth_version = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.cache = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87385) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.include_service_catalog = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.interface = public {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_password = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Running cmd (subprocess): mount.quobyte {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcache_username = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.region_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.service_type = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.backend = dogpile.cache.null {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.backend_argument = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.backend_expiration_time = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.config_prefix = cache.oslo {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.debug_cache_backend = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.enable_retry_client = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.enable_socket_keepalive = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.expiration_time = 600 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.hashclient_retry_attempts = 2 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_dead_retry = 300 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_pool_maxsize = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_sasl_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.proxies = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.redis_db = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.redis_server = localhost:6379 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.retry_attempts = 2 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.retry_delay = 0.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.socket_keepalive_count = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.socket_keepalive_idle = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.socket_keepalive_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.socket_timeout = 1.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.tls_allowed_ciphers = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.tls_cafile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.tls_certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.tls_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.tls_keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cache.username = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] coordination.backend_url = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.asyncio_connection = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.asyncio_slave_connection = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.backend = sqlalchemy {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.connection = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.connection_debug = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.connection_parameters = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.connection_recycle_time = 3600 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.connection_trace = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.db_inc_retry_interval = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.db_max_retries = 20 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.db_max_retry_interval = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.db_retry_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.max_overflow = 50 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.max_pool_size = 5 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.max_retries = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.mysql_wsrep_sync_wait = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.pool_timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.retry_interval = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.slave_connection = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.sqlite_synchronous = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.synchronous_reader = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] database.use_db_reconnect = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.connection_string = messaging:// {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.es_doc_type = notification {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.es_scroll_size = 10000 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.es_scroll_time = 2m {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.filter_error_trace = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.hmac_keys = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.sentinel_service_name = mymaster {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.socket_timeout = 0.1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.trace_requests = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler.trace_sqlalchemy = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler_jaeger.process_tags = {} {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler_jaeger.service_name_prefix = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] profiler_otlp.service_name_prefix = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.enforce_new_defaults = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.policy_default_rule = default {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.policy_file = policy.yaml {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.group = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.helper_command = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] privsep_osbrick.user = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.group = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.helper_command = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] cinder_sys_admin.user = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.auth_section = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.auth_type = password {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.cafile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.collect_timing = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.send_service_user_token = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.split_loggers = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] service_user.timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.auth_section = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.auth_type = password {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.collect_timing = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack quobyte-client[87394]: Reading configuration file: /etc/quobyte/client.cfg Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.region_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.split_loggers = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] glance.timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack quobyte-client[87394]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.backend_availability_zone = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.chap_password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.chap_username = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.disk_geometry = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_client_cert = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_client_cert_key = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_data_namespace = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.driver_use_ssl = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.extra_capabilities = {} {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.filter_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.goodness_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iscsi_target_flags = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iscsi_write_cache = on {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iser_helper = tgtadm {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iser_port = 3260 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_host = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_login = admin {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_mount_options = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_private_key = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_share_path = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.num_shell_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.quobyte_volume_url = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.replication_device = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.report_discard_supported = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.reserved_percentage = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_helper = tgtadm {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_port = 3260 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_protocol = iscsi {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.trace_flags = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.unique_fqdn_network = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.use_chap_auth = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_backend_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_clear = zero {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_clear_ionice = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_clear_size = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_reports.file_event_handler = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_reports.log_dir = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.backend_availability_zone = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.backend_host = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.chap_password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.chap_username = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.chiscsi_conf = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.disk_geometry = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_client_cert = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_data_namespace = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.driver_use_ssl = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.extra_capabilities = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.filter_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.goodness_function = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iser_helper = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iser_ip_address = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iser_port = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.iser_target_prefix = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_host = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_login = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_mount_options = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_password = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_private_key = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_share_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_ssh_port = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.num_shell_tries = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.nvmet_port_id = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.replication_device = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.report_discard_supported = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.reserved_percentage = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.scst_target_driver = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.storage_protocol = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_helper = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_ip_address = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_port = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_prefix = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_protocol = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.trace_flags = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.use_chap_auth = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_clear = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_clear_size = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] QuobyteHD.volumes_dir = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_notifications.driver = [] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_notifications.retry = -1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] key_manager.fixed_key = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.barbican_api_version = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.barbican_endpoint = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.barbican_endpoint_type = public {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.barbican_region_name = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.cafile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.collect_timing = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.number_of_retries = 60 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.retry_delay = 1 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.send_service_user_token = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.split_loggers = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.verify_ssl = True {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican.verify_ssl_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.auth_section = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.auth_type = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.cafile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.certfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.collect_timing = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.insecure = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.keyfile = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.split_loggers = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] barbican_service_user.timeout = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.approle_role_id = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.approle_secret_id = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.auth_method = approle {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.auth_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.kv_mountpoint = secret {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.kv_path = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.kv_version = 2 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.namespace = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.root_token_id = **** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.ssl_ca_crt_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.timeout = 60.0 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.token_file = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.token_role = None {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.use_ssl = False {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 28 14:23:43 devstack cinder-volume[87350]: DEBUG oslo_service.backend._eventlet.service [None req-31323c48-d573-451c-bf1f-61440334df9e None None] ******************************************************************************** {{(pid=87350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 28 14:23:43 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.volume.driver [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Driver hasn't implemented _init_vendor_properties() Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.driver [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87385) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_db.sqlalchemy.engines [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writer thread running {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.db.api [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Building query based on filter {{(pid=87385) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87385) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.keymgr.migration [None req-abe39089-07bf-454c-8099-f4ef079eb71b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 28 14:23:43 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:43 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:43 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Driver initialization completed successfully. Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Initiating service 3 cleanup Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Service 3 cleanup completed. Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.service [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Creating RPC server for service cinder-volume {{(pid=87385) start /opt/stack/cinder/cinder/service.py:231}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.service [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87385) start /opt/stack/cinder/cinder/service.py:237}} Jul 28 14:23:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:23:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:23:43 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:23:43 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:23:44 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Jul 28 14:23:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:23:44 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-470a4885-6187-4d11-b85c-4322748b4f65 None None] Driver post RPC initialization completed successfully. Jul 28 14:23:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:23:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 6 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:23:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:23:52 devstack cinder-volume[87350]: DEBUG dbcounter [-] [87350] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:23:53 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:23:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:24:49 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:24:49 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:24:49 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.226s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 6 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:24:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:25:49 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:25:49 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:25:49 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:25:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:25:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:26:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:26:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Flow 'volume_create_manager' (a1ab25f7-26bb-444f-a586-3282ed8881e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:26:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b88031-8336-4e76-b46a-0fa6f977ebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b88031-8336-4e76-b46a-0fa6f977ebdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-159504481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a8385-eeb7-446b-99b0-1c394c51aa3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='038be09634034c98a7b6b31dce3a60bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:39Z,use_quota=True,user_id='caa8d02f6e2b44eba32099c5d595af18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e1e45-0b43-46c6-a7aa-cd47a25984ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841e1e45-0b43-46c6-a7aa-cd47a25984ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ffa07f-c4e1-4710-a456-2cc7ecd2b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ffa07f-c4e1-4710-a456-2cc7ecd2b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786a8385-eeb7-446b-99b0-1c394c51aa3f', 'volume_name': 'volume-786a8385-eeb7-446b-99b0-1c394c51aa3f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ff82a3-acac-4dc5-b005-11f89f422778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ff82a3-acac-4dc5-b005-11f89f422778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219b7f9f-1c95-40a5-a1de-dfd2854fe314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Volume 786a8385-eeb7-446b-99b0-1c394c51aa3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786a8385-eeb7-446b-99b0-1c394c51aa3f', 'volume_size': 1} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-159504481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a8385-eeb7-446b-99b0-1c394c51aa3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='038be09634034c98a7b6b31dce3a60bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:39Z,use_quota=True,user_id='caa8d02f6e2b44eba32099c5d595af18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Creating volume 786a8385-eeb7-446b-99b0-1c394c51aa3f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:26:40 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:26:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:40 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f 1073741824 Jul 28 14:26:40 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:41 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f 1073741824" returned: 0 in 0.979s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:41 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f Jul 28 14:26:41 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:41 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f" returned: 0 in 0.464s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219b7f9f-1c95-40a5-a1de-dfd2854fe314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786a8385-eeb7-446b-99b0-1c394c51aa3f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e363d5a-4fec-48a6-82ff-38ab24b7e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Volume volume-786a8385-eeb7-446b-99b0-1c394c51aa3f (786a8385-eeb7-446b-99b0-1c394c51aa3f): created successfully Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e363d5a-4fec-48a6-82ff-38ab24b7e29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Flow 'volume_create_manager' (a1ab25f7-26bb-444f-a586-3282ed8881e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:26:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c035a73c-9e00-4f82-be19-80fbb4987f82 tempest-VolumesAdminNegativeTest-359585281 None] Created volume successfully. Jul 28 14:26:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Acquiring lock "cinder-786a8385-eeb7-446b-99b0-1c394c51aa3f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:26:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "cinder-786a8385-eeb7-446b-99b0-1c394c51aa3f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:26:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Acquiring lock "cinder-quobyte-786a8385-eeb7-446b-99b0-1c394c51aa3f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:26:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "cinder-quobyte-786a8385-eeb7-446b-99b0-1c394c51aa3f" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:26:42 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxf2y8p3b/privsep.sock'] Jul 28 14:26:42 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxf2y8p3b/privsep.sock Jul 28 14:26:42 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: Jul 28 14:26:44 devstack cinder-volume[87385]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 28 14:26:44 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:44 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Spawned new privsep daemon via rootwrap Jul 28 14:26:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Accepted privsep connection to /tmp/tmpxf2y8p3b/privsep.sock {{(pid=87385) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 28 14:26:44 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 28 14:26:44 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 28 14:26:44 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 28 14:26:44 devstack cinder-volume[87385]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89426 Jul 28 14:26:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8fb503-e137-4c28-a280-d7e881a314ac]: (2,) {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:26:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6982a29-f14c-4e91-b52b-cfb844511f10]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:26:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:45 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f Jul 28 14:26:45 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:45 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f" returned: 0 in 0.543s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:45 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f Jul 28 14:26:45 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:45 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-786a8385-eeb7-446b-99b0-1c394c51aa3f" returned: 0 in 0.518s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "cinder-quobyte-786a8385-eeb7-446b-99b0-1c394c51aa3f" released by "delete_volume" :: held 3.392s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:26:46 devstack cinder-volume[87385]: WARNING cinder.quota [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:26:46 devstack cinder-volume[87385]: WARNING cinder.quota [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Created reservations ['bbca0aee-000f-445b-91a1-7ae451223bbc', 'fee7c46c-ad96-4e15-af97-d6cc96e292b4', '6bd171ff-b26d-4b21-b7ac-693ec78a8285', '3824825e-decf-4b87-8c96-38955d9be9f0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:46 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:26:46 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:46 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.309s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:26:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Deleted volume successfully. Jul 28 14:26:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a631c689-299f-4574-9aec-8aefff8c531a tempest-VolumesAdminNegativeTest-359585281 None] Lock "cinder-786a8385-eeb7-446b-99b0-1c394c51aa3f-delete_volume" released by "delete_volume" :: held 4.150s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:49 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:26:49 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:49 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.277s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 8 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:26:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:26:56 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:26:56 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:26:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:26:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Flow 'volume_create_manager' (3746eaa4-7bac-4f76-9818-cd8999881af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:26:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cbaebb-9230-4f3e-b124-4ff118860a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cbaebb-9230-4f3e-b124-4ff118860a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1759887627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0663fdd9-8e30-4011-8fed-f40a864604ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65d975da615498b8ff3d18c2d77f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:58Z,use_quota=True,user_id='9612c4bb92e5410ba9d0a181efd20ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d758264b-2836-4af9-a46a-17e5016ae879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d758264b-2836-4af9-a46a-17e5016ae879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8e9e0-d8b9-455e-816e-fbb1926aab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8e9e0-d8b9-455e-816e-fbb1926aab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0663fdd9-8e30-4011-8fed-f40a864604ba', 'volume_name': 'volume-0663fdd9-8e30-4011-8fed-f40a864604ba', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a48704a-85b1-44a0-bf7d-2f8fc80db23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a48704a-85b1-44a0-bf7d-2f8fc80db23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc10c07-c88c-4191-a113-2da982c716c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Volume 0663fdd9-8e30-4011-8fed-f40a864604ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0663fdd9-8e30-4011-8fed-f40a864604ba', 'volume_size': 1} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1759887627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0663fdd9-8e30-4011-8fed-f40a864604ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65d975da615498b8ff3d18c2d77f938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:58Z,use_quota=True,user_id='9612c4bb92e5410ba9d0a181efd20ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Creating volume 0663fdd9-8e30-4011-8fed-f40a864604ba {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:26:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:58 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba 1073741824 Jul 28 14:26:58 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:58 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba 1073741824" returned: 0 in 0.745s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:26:59 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (9db486b3-a7c0-4839-8349-cb999c5a2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:26:59 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52acc734-080c-42ea-bb04-5a53b148659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52acc734-080c-42ea-bb04-5a53b148659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1436237862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55685a8d-d2a3-40d2-80f4-9272006e3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:59Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ae5a2b-d906-4b97-8a67-e6e76187aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ae5a2b-d906-4b97-8a67-e6e76187aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651d5cb1-8ad5-4621-9e1b-da1fe7357ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651d5cb1-8ad5-4621-9e1b-da1fe7357ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55685a8d-d2a3-40d2-80f4-9272006e3908', 'volume_name': 'volume-55685a8d-d2a3-40d2-80f4-9272006e3908', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b75d34-035f-4014-bf96-16a030e2b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b75d34-035f-4014-bf96-16a030e2b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668dfad-18f8-47a2-9a9e-eab475893bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Volume 55685a8d-d2a3-40d2-80f4-9272006e3908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55685a8d-d2a3-40d2-80f4-9272006e3908', 'volume_size': 1} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:59 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1436237862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55685a8d-d2a3-40d2-80f4-9272006e3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:26:59Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Creating volume 55685a8d-d2a3-40d2-80f4-9272006e3908 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:26:59 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc10c07-c88c-4191-a113-2da982c716c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0663fdd9-8e30-4011-8fed-f40a864604ba', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7b8ec8-76a8-45d5-80dd-de5ad86be2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:26:59 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 1073741824 Jul 28 14:26:59 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:26:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Volume volume-0663fdd9-8e30-4011-8fed-f40a864604ba (0663fdd9-8e30-4011-8fed-f40a864604ba): created successfully Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7b8ec8-76a8-45d5-80dd-de5ad86be2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Flow 'volume_create_manager' (3746eaa4-7bac-4f76-9818-cd8999881af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:26:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-aaa564e4-6d7e-4db9-91ba-1a4f6f81007a tempest-ServerActionsTestOtherA-2120462880 None] Created volume successfully. Jul 28 14:26:59 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 1073741824" returned: 0 in 0.564s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:26:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:26:59 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 Jul 28 14:26:59 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:00 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668dfad-18f8-47a2-9a9e-eab475893bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55685a8d-d2a3-40d2-80f4-9272006e3908', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0cf0a6-a17b-4d91-b979-6d6602f32acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Volume volume-55685a8d-d2a3-40d2-80f4-9272006e3908 (55685a8d-d2a3-40d2-80f4-9272006e3908): created successfully Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0cf0a6-a17b-4d91-b979-6d6602f32acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (9db486b3-a7c0-4839-8349-cb999c5a2365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:00 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d36c9afe-a652-4be6-917c-7a1ccc1cc7e0 tempest-AttachVolumeNegativeTest-221585927 None] Created volume successfully. Jul 28 14:27:04 devstack cinder-volume[87385]: WARNING py.warnings [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 28 14:27:04 devstack cinder-volume[87385]: .first() Jul 28 14:27:04 devstack cinder-volume[87385]: Jul 28 14:27:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-55685a8d-d2a3-40d2-80f4-9272006e3908', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3de8bec1-0fea-49b9-8c6a-b6673d328b16', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:27:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-6428c764-e99c-42e3-9de9-cbc0989d1d56 req-90634517-b088-449d-b1ae-14cf5c848817 tempest-AttachVolumeNegativeTest-221585927 None] attachment_update completed successfully. Jul 28 14:27:14 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:27:14 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Flow 'volume_create_manager' (2b93dd3d-1d87-410d-87af-8fa063f0663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3874eb17-3283-47ce-aa41-39ebcc34964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3874eb17-3283-47ce-aa41-39ebcc34964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1475906591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de7e6b3-352f-4575-b790-063dd8a08782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e61431c5ce4d18a3a66f81ea449e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:23Z,use_quota=True,user_id='8f6b4066f35b44ee9ea494fe84297f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922123b1-2a85-4664-98f4-3fe9c9f77d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922123b1-2a85-4664-98f4-3fe9c9f77d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de9e2fe-d97d-4f7d-a3ba-3308242b2e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de9e2fe-d97d-4f7d-a3ba-3308242b2e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de7e6b3-352f-4575-b790-063dd8a08782', 'volume_name': 'volume-5de7e6b3-352f-4575-b790-063dd8a08782', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106e0fb-3b66-483a-a152-76f5a3e6d3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106e0fb-3b66-483a-a152-76f5a3e6d3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d311cc56-32b8-442d-bfaf-3e7bca22a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:22 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Volume 5de7e6b3-352f-4575-b790-063dd8a08782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de7e6b3-352f-4575-b790-063dd8a08782', 'volume_size': 1} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1475906591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de7e6b3-352f-4575-b790-063dd8a08782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e61431c5ce4d18a3a66f81ea449e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:23Z,use_quota=True,user_id='8f6b4066f35b44ee9ea494fe84297f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Creating volume 5de7e6b3-352f-4575-b790-063dd8a08782 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:27:22 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:27:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:22 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 1073741824 Jul 28 14:27:22 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:23 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 1073741824" returned: 0 in 0.888s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:23 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 Jul 28 14:27:23 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:24 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782" returned: 0 in 0.876s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d311cc56-32b8-442d-bfaf-3e7bca22a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de7e6b3-352f-4575-b790-063dd8a08782', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8054ca-4c4e-4746-8e17-dc14d1433fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Volume volume-5de7e6b3-352f-4575-b790-063dd8a08782 (5de7e6b3-352f-4575-b790-063dd8a08782): created successfully Jul 28 14:27:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8054ca-4c4e-4746-8e17-dc14d1433fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Flow 'volume_create_manager' (2b93dd3d-1d87-410d-87af-8fa063f0663d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c6d68210-6928-428d-b3b8-9e953eb37c30 tempest-DeleteServersTestJSON-1168646323 None] Created volume successfully. Jul 28 14:27:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6ff46d5c-f91e-48af-90ae-58d5fee2c254 req-fe078881-10fd-4d76-80d7-22e01c219346 tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6ff46d5c-f91e-48af-90ae-58d5fee2c254 req-fe078881-10fd-4d76-80d7-22e01c219346 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-6ff46d5c-f91e-48af-90ae-58d5fee2c254 req-fe078881-10fd-4d76-80d7-22e01c219346 tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-6ff46d5c-f91e-48af-90ae-58d5fee2c254 req-fe078881-10fd-4d76-80d7-22e01c219346 tempest-DeleteServersTestJSON-1168646323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-5de7e6b3-352f-4575-b790-063dd8a08782', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08c2176a-3550-42a1-a416-3c3d0dff5204', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:27:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-6ff46d5c-f91e-48af-90ae-58d5fee2c254 req-fe078881-10fd-4d76-80d7-22e01c219346 tempest-DeleteServersTestJSON-1168646323 None] attachment_update completed successfully. Jul 28 14:27:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-586d82d0-b975-43ca-9751-ba5a9e5545d7 req-8caed035-b219-4051-85e6-1971fabd5bd6 tempest-DeleteServersTestJSON-1168646323 None] Terminate volume connection completed successfully. Jul 28 14:27:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-586d82d0-b975-43ca-9751-ba5a9e5545d7 req-8caed035-b219-4051-85e6-1971fabd5bd6 tempest-DeleteServersTestJSON-1168646323 None] Deleting attachment 08c2176a-3550-42a1-a416-3c3d0dff5204. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "cinder-5de7e6b3-352f-4575-b790-063dd8a08782-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "cinder-5de7e6b3-352f-4575-b790-063dd8a08782-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "cinder-quobyte-5de7e6b3-352f-4575-b790-063dd8a08782" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "cinder-quobyte-5de7e6b3-352f-4575-b790-063dd8a08782" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[269796ea-610f-4f76-84fe-e4e4aab33362]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:37 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 Jul 28 14:27:37 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:37 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782" returned: 0 in 0.391s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:37 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782 Jul 28 14:27:37 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:37 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5de7e6b3-352f-4575-b790-063dd8a08782" returned: 0 in 0.281s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "cinder-quobyte-5de7e6b3-352f-4575-b790-063dd8a08782" released by "delete_volume" :: held 0.761s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Created reservations ['25cf5911-bd03-4c05-bce3-37b0d06bddad', '988067d3-4826-4100-92d4-2443bd17382b', '7e7356f5-15ee-47bb-820b-ef8d12ac9f95', '74041e70-055f-42f7-b9bb-8cb7715b965a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:38 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:27:38 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:38 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:27:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Deleted volume successfully. Jul 28 14:27:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3db49a03-f14f-4cd8-88ea-b9f5bbf0124b tempest-DeleteServersTestJSON-1168646323 None] Lock "cinder-5de7e6b3-352f-4575-b790-063dd8a08782-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (2584393a-7f5f-4ede-ba7a-2fc572998259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100b5c06-3e17-434c-94bb-11fe9bb2521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100b5c06-3e17-434c-94bb-11fe9bb2521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1409883535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e715716d-90c2-46d4-8b1f-e9b39bae15eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:48Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d376a5b4-8491-419e-98b4-df77113a5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d376a5b4-8491-419e-98b4-df77113a5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8748a1-f0b7-4766-b480-0c4f7cdeca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8748a1-f0b7-4766-b480-0c4f7cdeca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e715716d-90c2-46d4-8b1f-e9b39bae15eb', 'volume_name': 'volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6153cf9e-57fc-405e-ac20-3b1ccc06bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6153cf9e-57fc-405e-ac20-3b1ccc06bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed32c5a-a040-4b22-af4e-f9295ef77f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:48 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Volume e715716d-90c2-46d4-8b1f-e9b39bae15eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb', 'volume_size': 1} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1409883535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e715716d-90c2-46d4-8b1f-e9b39bae15eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:48Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Creating volume e715716d-90c2-46d4-8b1f-e9b39bae15eb {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:27:48 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:48 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb 1073741824 Jul 28 14:27:48 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-295e583c-f207-44e7-ba79-c418c7f1724b req-ae998f96-c84b-4b28-a9d7-cfb22393e0d1 tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:48 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb 1073741824" returned: 0 in 0.479s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:49 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb Jul 28 14:27:49 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:49 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:27:49 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:49 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-295e583c-f207-44e7-ba79-c418c7f1724b req-ae998f96-c84b-4b28-a9d7-cfb22393e0d1 tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.555s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-295e583c-f207-44e7-ba79-c418c7f1724b req-ae998f96-c84b-4b28-a9d7-cfb22393e0d1 tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed32c5a-a040-4b22-af4e-f9295ef77f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aaa299-7b1a-4b47-9495-b1720e4c7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:49 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Volume volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb (e715716d-90c2-46d4-8b1f-e9b39bae15eb): created successfully Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aaa299-7b1a-4b47-9495-b1720e4c7d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (2584393a-7f5f-4ede-ba7a-2fc572998259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-295e583c-f207-44e7-ba79-c418c7f1724b req-ae998f96-c84b-4b28-a9d7-cfb22393e0d1 tempest-ServerActionsTestOtherA-2120462880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-0663fdd9-8e30-4011-8fed-f40a864604ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb8bada0-d00c-44ac-902c-cfe2134920d4', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:27:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d414084d-28ec-4354-a8bb-1d659de9c4f9 tempest-VolumesTestJSON-573410199 None] Created volume successfully. Jul 28 14:27:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-295e583c-f207-44e7-ba79-c418c7f1724b req-ae998f96-c84b-4b28-a9d7-cfb22393e0d1 tempest-ServerActionsTestOtherA-2120462880 None] attachment_update completed successfully. Jul 28 14:27:49 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 8 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:27:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Flow 'volume_create_manager' (d142e976-8e08-4727-b4d2-78493e15e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0a756f-7cd9-49e1-bb24-0bd5155a9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0a756f-7cd9-49e1-bb24-0bd5155a9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-538026186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045cf323-708f-4873-b38e-e6c6a828811d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49511cef10142db8e521df5767608d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:50Z,use_quota=True,user_id='d56c939fef3c42de9a8bec96615cef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9c6cc4-00a0-4d9b-bb30-e0899fb9b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9c6cc4-00a0-4d9b-bb30-e0899fb9b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f068ff6-471b-4c84-95f2-0fabf1ecb8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f068ff6-471b-4c84-95f2-0fabf1ecb8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045cf323-708f-4873-b38e-e6c6a828811d', 'volume_name': 'volume-045cf323-708f-4873-b38e-e6c6a828811d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b14264-06d1-4ac4-bee4-c42908b9e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b14264-06d1-4ac4-bee4-c42908b9e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641b4a3c-1f13-4f11-9f9b-b724e6d3f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:50 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Volume 045cf323-708f-4873-b38e-e6c6a828811d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045cf323-708f-4873-b38e-e6c6a828811d', 'volume_size': 1} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-538026186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045cf323-708f-4873-b38e-e6c6a828811d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49511cef10142db8e521df5767608d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:50Z,use_quota=True,user_id='d56c939fef3c42de9a8bec96615cef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Creating volume 045cf323-708f-4873-b38e-e6c6a828811d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:27:50 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:27:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:50 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d 1073741824 Jul 28 14:27:50 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:27:51 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (2ff785e0-8431-4004-9fe6-0796f591e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c0ea95-514d-410e-a5e5-1458a2fccf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d 1073741824" returned: 0 in 0.536s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c0ea95-514d-410e-a5e5-1458a2fccf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1208579682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487a2249-1ce2-4fb6-a2e3-c93a75dfb273,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:51Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384f8d1a-eeb8-4d11-b018-19251b409604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384f8d1a-eeb8-4d11-b018-19251b409604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774150e-bd38-4d27-8276-c931154494d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774150e-bd38-4d27-8276-c931154494d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487a2249-1ce2-4fb6-a2e3-c93a75dfb273', 'volume_name': 'volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49208f-eeb1-494f-be63-03892c3d455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b49208f-eeb1-494f-be63-03892c3d455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b9a5ac-e9b8-4537-b54f-b21c58cb1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Volume 487a2249-1ce2-4fb6-a2e3-c93a75dfb273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273', 'volume_size': 1} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:51 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d Jul 28 14:27:51 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:51 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1208579682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487a2249-1ce2-4fb6-a2e3-c93a75dfb273,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:51Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Creating volume 487a2249-1ce2-4fb6-a2e3-c93a75dfb273 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:27:51 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641b4a3c-1f13-4f11-9f9b-b724e6d3f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045cf323-708f-4873-b38e-e6c6a828811d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437160b6-420c-4ec2-aa4a-ea43c9b4f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:51 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 1073741824 Jul 28 14:27:51 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:51 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Volume volume-045cf323-708f-4873-b38e-e6c6a828811d (045cf323-708f-4873-b38e-e6c6a828811d): created successfully Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437160b6-420c-4ec2-aa4a-ea43c9b4f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Flow 'volume_create_manager' (d142e976-8e08-4727-b4d2-78493e15e579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-368c8bf7-3383-4155-849e-ae299529bc8e tempest-TaggedAttachmentsTest-1907644880 None] Created volume successfully. Jul 28 14:27:52 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 1073741824" returned: 0 in 0.683s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:52 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 Jul 28 14:27:52 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:52 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" returned: 0 in 0.308s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b9a5ac-e9b8-4537-b54f-b21c58cb1181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b301d-9865-4745-95a9-005c0d6912fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:52 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Volume volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 (487a2249-1ce2-4fb6-a2e3-c93a75dfb273): created successfully Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b301d-9865-4745-95a9-005c0d6912fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (2ff785e0-8431-4004-9fe6-0796f591e446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e116b16a-3683-4570-855c-ee452409fa33 tempest-VolumesTestJSON-573410199 None] Created volume successfully. Jul 28 14:27:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-d4bf8c5e-3f16-48a2-904b-57ad104052d1 tempest-ServerActionsTestOtherA-2120462880 None] Terminate volume connection completed successfully. Jul 28 14:27:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-d4bf8c5e-3f16-48a2-904b-57ad104052d1 tempest-ServerActionsTestOtherA-2120462880 None] Deleting attachment eb8bada0-d00c-44ac-902c-cfe2134920d4. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-a0e99023-a1d3-4a10-871b-9e2d4fab64da tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-a0e99023-a1d3-4a10-871b-9e2d4fab64da tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-a0e99023-a1d3-4a10-871b-9e2d4fab64da tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-a0e99023-a1d3-4a10-871b-9e2d4fab64da tempest-ServerActionsTestOtherA-2120462880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-0663fdd9-8e30-4011-8fed-f40a864604ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc560fd2-3d58-4c04-a094-5f4bdd6a9a9e', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (370e0254-8c77-41a0-ab3b-34b55b306d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7832dc-a020-4c89-8095-28a2bc12b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7832dc-a020-4c89-8095-28a2bc12b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015512888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd019f1-fb29-4617-b688-aee90959e6a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:54Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c7930c-c3d3-411a-aec5-2aca30753c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c7930c-c3d3-411a-aec5-2aca30753c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738488de-792a-4ba9-934b-fb0e94968a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738488de-792a-4ba9-934b-fb0e94968a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd019f1-fb29-4617-b688-aee90959e6a3', 'volume_name': 'volume-3cd019f1-fb29-4617-b688-aee90959e6a3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6d8962-be5f-4582-9dd0-758b9517b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6d8962-be5f-4582-9dd0-758b9517b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc08b5e-efe0-46ac-9f12-12b434b31e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Volume 3cd019f1-fb29-4617-b688-aee90959e6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd019f1-fb29-4617-b688-aee90959e6a3', 'volume_size': 1} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1015512888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd019f1-fb29-4617-b688-aee90959e6a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dde60520f39f49369adffeeaa762aee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:27:54Z,use_quota=True,user_id='21166ac17f5249649d89c9cfd3b1d3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Creating volume 3cd019f1-fb29-4617-b688-aee90959e6a3 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:27:54 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:27:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:54 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 1073741824 Jul 28 14:27:54 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-053bb52f-8515-4825-8189-4c1e8ed26bd0 req-a0e99023-a1d3-4a10-871b-9e2d4fab64da tempest-ServerActionsTestOtherA-2120462880 None] attachment_update completed successfully. Jul 28 14:27:55 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 1073741824" returned: 0 in 0.588s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:55 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 Jul 28 14:27:55 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:55 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3" returned: 0 in 0.293s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc08b5e-efe0-46ac-9f12-12b434b31e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd019f1-fb29-4617-b688-aee90959e6a3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e86fb3-b132-44a3-ad26-edbfd74f8eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:27:55 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Volume volume-3cd019f1-fb29-4617-b688-aee90959e6a3 (3cd019f1-fb29-4617-b688-aee90959e6a3): created successfully Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e86fb3-b132-44a3-ad26-edbfd74f8eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:27:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Flow 'volume_create_manager' (370e0254-8c77-41a0-ab3b-34b55b306d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:27:55 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d0014c2d-de3d-4394-abe6-ed130a9e5040 tempest-VolumesTestJSON-573410199 None] Created volume successfully. Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-3cd019f1-fb29-4617-b688-aee90959e6a3-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "cinder-3cd019f1-fb29-4617-b688-aee90959e6a3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:27:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-6ab7ac59-82f8-41cb-8844-7e0de00b1189 req-2131dc88-8c1c-45bf-a225-3ac13356a055 tempest-AttachVolumeNegativeTest-221585927 None] Terminate volume connection completed successfully. Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-6ab7ac59-82f8-41cb-8844-7e0de00b1189 req-2131dc88-8c1c-45bf-a225-3ac13356a055 tempest-AttachVolumeNegativeTest-221585927 None] Deleting attachment 3de8bec1-0fea-49b9-8c6a-b6673d328b16. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-quobyte-3cd019f1-fb29-4617-b688-aee90959e6a3" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-3cd019f1-fb29-4617-b688-aee90959e6a3" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[849b4812-8f5e-4164-8b25-2599b85a35af]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:27:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:59 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 Jul 28 14:27:59 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:27:59 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Jul 28 14:27:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3" returned: 0 in 0.660s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:27:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:27:59 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3 Jul 28 14:27:59 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:00 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3cd019f1-fb29-4617-b688-aee90959e6a3" returned: 0 in 0.700s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-3cd019f1-fb29-4617-b688-aee90959e6a3" released by "delete_volume" :: held 1.427s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Created reservations ['93b4543d-e21b-47ce-9b71-7d5799260316', 'a358b0f1-5fb6-411a-8fdd-bf1a8d9038e1', '19079ea9-04e2-4ed1-96e1-ae79cd1d6826', '16739f71-5f9b-4367-acbc-b33fac730217'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:00 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:00 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:01 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.476s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Deleted volume successfully. Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-75205a56-eb42-4252-bc39-a463ea95f28f tempest-VolumesTestJSON-573410199 None] Lock "cinder-3cd019f1-fb29-4617-b688-aee90959e6a3-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-487a2249-1ce2-4fb6-a2e3-c93a75dfb273-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "cinder-487a2249-1ce2-4fb6-a2e3-c93a75dfb273-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-quobyte-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[774481d9-4590-471a-a00f-aa0294453c68]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:01 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 Jul 28 14:28:01 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:02 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" returned: 0 in 0.705s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:02 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273 Jul 28 14:28:02 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:02 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-487a2249-1ce2-4fb6-a2e3-c93a75dfb273" released by "delete_volume" :: held 1.199s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Created reservations ['2c3c6061-187a-4748-af3c-4a136194e39f', '3d680706-a277-4071-a484-83fe6ac4b9c7', 'd2a86582-7d11-4dd0-815b-07851a65a905', 'bece6a99-dcc8-4225-b0f2-95e723207d49'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:02 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:02 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:03 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Deleted volume successfully. Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68fbaac2-10f1-4163-b23c-3f10dcee2753 tempest-VolumesTestJSON-573410199 None] Lock "cinder-487a2249-1ce2-4fb6-a2e3-c93a75dfb273-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-e715716d-90c2-46d4-8b1f-e9b39bae15eb-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "cinder-e715716d-90c2-46d4-8b1f-e9b39bae15eb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Acquiring lock "cinder-quobyte-e715716d-90c2-46d4-8b1f-e9b39bae15eb" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-e715716d-90c2-46d4-8b1f-e9b39bae15eb" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb26c4-5037-4e58-96a4-1409c0b52df4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:04 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb Jul 28 14:28:04 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:04 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:04 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb Jul 28 14:28:04 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:04 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e715716d-90c2-46d4-8b1f-e9b39bae15eb" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "cinder-quobyte-e715716d-90c2-46d4-8b1f-e9b39bae15eb" released by "delete_volume" :: held 0.998s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Created reservations ['f5a01cf8-4d84-43e7-acf6-0c07d91043eb', '225b26ad-9871-40d3-9314-174b018adb91', '107378ac-6bee-4002-aac6-568d7d0c74f0', 'ecd2cdf5-2a84-47f7-9a27-97b453b1744b'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:05 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:05 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:05 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.513s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Deleted volume successfully. Jul 28 14:28:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-70d79f60-fd44-4614-a55a-4e162f9ed4cf tempest-VolumesTestJSON-573410199 None] Lock "cinder-e715716d-90c2-46d4-8b1f-e9b39bae15eb-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:15 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=52,cinder:SELECT=54,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:28:15 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=52,cinder:UPDATE=52,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:28:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-489c9c8a-b741-4fa7-9011-d0e7cebd9948 req-6fd5d3c4-d5c7-4f02-867a-710efa1764cb tempest-ServerActionsTestOtherA-2120462880 None] Terminate volume connection completed successfully. Jul 28 14:28:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-489c9c8a-b741-4fa7-9011-d0e7cebd9948 req-6fd5d3c4-d5c7-4f02-867a-710efa1764cb tempest-ServerActionsTestOtherA-2120462880 None] Deleting attachment bc560fd2-3d58-4c04-a094-5f4bdd6a9a9e. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "cinder-0663fdd9-8e30-4011-8fed-f40a864604ba-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "cinder-0663fdd9-8e30-4011-8fed-f40a864604ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "cinder-quobyte-0663fdd9-8e30-4011-8fed-f40a864604ba" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "cinder-quobyte-0663fdd9-8e30-4011-8fed-f40a864604ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e43ee0a-bac3-4d12-a298-bdd524d3df49]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:28 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba Jul 28 14:28:28 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:29 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:29 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba Jul 28 14:28:29 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:29 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0663fdd9-8e30-4011-8fed-f40a864604ba" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "cinder-quobyte-0663fdd9-8e30-4011-8fed-f40a864604ba" released by "delete_volume" :: held 0.718s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Created reservations ['0b003863-3a06-442d-ac7a-d8dd8eb73592', '4f102fca-462d-4290-85c4-c311e56ab797', 'd71be943-b385-428a-900a-96e8b5a2050e', '00621fd9-52a7-4380-9a2c-3207206c760c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2419b3c2-bc03-4414-a80f-5f54160df73d tempest-GroupsTest-416931564 None] Group tempest-Group1-1032715468: creating Jul 28 14:28:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2419b3c2-bc03-4414-a80f-5f54160df73d tempest-GroupsTest-416931564 None] Group tempest-Group1-1032715468: created successfully Jul 28 14:28:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2419b3c2-bc03-4414-a80f-5f54160df73d tempest-GroupsTest-416931564 None] Create group completed successfully. Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:29 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:29 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:29 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Deleted volume successfully. Jul 28 14:28:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dc5aa60b-2d97-4bd7-bc7a-dfa3e46e7a95 tempest-ServerActionsTestOtherA-2120462880 None] Lock "cinder-0663fdd9-8e30-4011-8fed-f40a864604ba-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-60e74434-a48d-4854-be47-6b23e3140ec5 tempest-GroupsTest-416931564 None] Group tempest-Group2-50224270: creating Jul 28 14:28:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-60e74434-a48d-4854-be47-6b23e3140ec5 tempest-GroupsTest-416931564 None] Group tempest-Group2-50224270: created successfully Jul 28 14:28:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-60e74434-a48d-4854-be47-6b23e3140ec5 tempest-GroupsTest-416931564 None] Create group completed successfully. Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (1c6b4d6b-ba0b-4672-bfd6-39fcb38db1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a55a6-9be2-466d-b06a-5f6981e6ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a55a6-9be2-466d-b06a-5f6981e6ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784694090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0058115-e096-4961-9852-9464ba95091e,host='devstack@QuobyteHD#QuobyteHD',id=78277b96-8977-46a1-9c0d-09385aab9c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:33Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(963e094f-9e60-4bab-9dc3-0c0eebcdafb9),volume_type_id=963e094f-9e60-4bab-9dc3-0c0eebcdafb9)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042abd1e-fc88-4c70-9156-219710ba6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042abd1e-fc88-4c70-9156-219710ba6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d4c68-7355-4dcb-8ce2-7c5a03d2bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d4c68-7355-4dcb-8ce2-7c5a03d2bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78277b96-8977-46a1-9c0d-09385aab9c3d', 'volume_name': 'volume-78277b96-8977-46a1-9c0d-09385aab9c3d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fded76-e6b3-4ee3-89d1-e1b604f787c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fded76-e6b3-4ee3-89d1-e1b604f787c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9187322c-e990-40da-a9dc-c3dde46dc2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Volume 78277b96-8977-46a1-9c0d-09385aab9c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78277b96-8977-46a1-9c0d-09385aab9c3d', 'volume_size': 1} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0058115-e096-4961-9852-9464ba95091e,created_at=2026-07-28T12:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-784694090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0058115-e096-4961-9852-9464ba95091e,host='devstack@QuobyteHD#QuobyteHD',id=78277b96-8977-46a1-9c0d-09385aab9c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:33Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(963e094f-9e60-4bab-9dc3-0c0eebcdafb9),volume_type_id=963e094f-9e60-4bab-9dc3-0c0eebcdafb9)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Creating volume 78277b96-8977-46a1-9c0d-09385aab9c3d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:28:32 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:28:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:32 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d 1073741824 Jul 28 14:28:32 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:33 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d 1073741824" returned: 0 in 0.674s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:33 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d Jul 28 14:28:33 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:33 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9187322c-e990-40da-a9dc-c3dde46dc2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78277b96-8977-46a1-9c0d-09385aab9c3d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543ce481-e2f3-4401-b57c-069e3c847095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Volume volume-78277b96-8977-46a1-9c0d-09385aab9c3d (78277b96-8977-46a1-9c0d-09385aab9c3d): created successfully Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543ce481-e2f3-4401-b57c-069e3c847095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (1c6b4d6b-ba0b-4672-bfd6-39fcb38db1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e01d0dd4-4bc9-405f-8a63-7b9103f769cb tempest-GroupsTest-416931564 None] Created volume successfully. Jul 28 14:28:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Acquiring lock "cinder-quobyte-78277b96-8977-46a1-9c0d-09385aab9c3d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-78277b96-8977-46a1-9c0d-09385aab9c3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f05e67-316a-4209-a252-e544300eee75]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:35 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d Jul 28 14:28:35 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:36 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d" returned: 0 in 0.415s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:36 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d Jul 28 14:28:36 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:36 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78277b96-8977-46a1-9c0d-09385aab9c3d" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-78277b96-8977-46a1-9c0d-09385aab9c3d" released by "delete_volume" :: held 0.753s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Created reservations ['1f61cac9-3022-416b-a447-c1e12ace249a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-415466352 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-415466352, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:28:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-415466352 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-415466352, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Created reservations ['e1c45799-b6b6-49f4-a537-7030e86ca766', '4256629a-9490-4923-8d42-0f83ba84c19a', '4da0ae6c-919c-4d30-8ea5-30207a6bd85e', 'f228010b-c4dd-4174-94b7-ea2c6445e908'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:36 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:36 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:37 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.620s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-efbd414e-020e-4955-8bd1-d6fa772d4d36 tempest-GroupsTest-416931564 None] Delete group completed successfully. Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Created reservations ['3cc0a989-049b-44b1-90c9-5bb5dcb3f492'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:37 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:37 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:38 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.551s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d00fd08a-e512-456c-a884-b10a81f2ce6b tempest-GroupsTest-416931564 None] Delete group completed successfully. Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-24d29a3c-50d8-43b0-b57c-4d738121d4c1 req-a5d10356-de46-4d44-8be8-335f7e33c05e tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-24d29a3c-50d8-43b0-b57c-4d738121d4c1 req-a5d10356-de46-4d44-8be8-335f7e33c05e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-24d29a3c-50d8-43b0-b57c-4d738121d4c1 req-a5d10356-de46-4d44-8be8-335f7e33c05e tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-24d29a3c-50d8-43b0-b57c-4d738121d4c1 req-a5d10356-de46-4d44-8be8-335f7e33c05e tempest-TaggedAttachmentsTest-1907644880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-045cf323-708f-4873-b38e-e6c6a828811d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68478e4a-e99d-4ce7-b9a5-7c8032f2b274', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:28:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-24d29a3c-50d8-43b0-b57c-4d738121d4c1 req-a5d10356-de46-4d44-8be8-335f7e33c05e tempest-TaggedAttachmentsTest-1907644880 None] attachment_update completed successfully. Jul 28 14:28:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90108742-55ff-4519-94cc-c780e9143b05 tempest-GroupsTest-416931564 None] Group tempest-GroupsTest-Group-126755587: creating Jul 28 14:28:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90108742-55ff-4519-94cc-c780e9143b05 tempest-GroupsTest-416931564 None] Group tempest-GroupsTest-Group-126755587: created successfully Jul 28 14:28:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90108742-55ff-4519-94cc-c780e9143b05 tempest-GroupsTest-416931564 None] Create group completed successfully. Jul 28 14:28:40 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:28:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (dc5ba4d0-605b-49a6-8187-2c628de72e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11344df6-e245-447a-b9db-c41ae45b95d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11344df6-e245-447a-b9db-c41ae45b95d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014683653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2661f09-090c-49e1-b98f-4178d40d7657,host='devstack@QuobyteHD#QuobyteHD',id=e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:41Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c1fa33-98e2-4eec-825f-5c261b2d7548),volume_type_id=54c1fa33-98e2-4eec-825f-5c261b2d7548)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76389ff-8854-4db6-bbd9-1231e1df3cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76389ff-8854-4db6-bbd9-1231e1df3cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450b95d2-efe6-44e5-b8bd-5a1be6e953b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450b95d2-efe6-44e5-b8bd-5a1be6e953b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa', 'volume_name': 'volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd79bd-98c9-4eba-a8cd-ba93bf85faa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcd79bd-98c9-4eba-a8cd-ba93bf85faa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124336be-0419-4e74-985b-2803b6a39a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Volume e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa', 'volume_size': 1} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2661f09-090c-49e1-b98f-4178d40d7657,created_at=2026-07-28T12:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014683653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2661f09-090c-49e1-b98f-4178d40d7657,host='devstack@QuobyteHD#QuobyteHD',id=e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:41Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c1fa33-98e2-4eec-825f-5c261b2d7548),volume_type_id=54c1fa33-98e2-4eec-825f-5c261b2d7548)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Creating volume e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:28:41 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:41 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa 1073741824 Jul 28 14:28:41 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:41 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa 1073741824" returned: 0 in 0.611s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:41 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa Jul 28 14:28:41 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:42 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" returned: 0 in 0.394s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124336be-0419-4e74-985b-2803b6a39a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c088920e-31f5-40ad-8937-014797844cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Volume volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa (e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa): created successfully Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c088920e-31f5-40ad-8937-014797844cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (dc5ba4d0-605b-49a6-8187-2c628de72e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-09290880-a28b-4c61-9334-768c9c807fe9 tempest-GroupsTest-416931564 None] Created volume successfully. Jul 28 14:28:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-5334a3f2-c877-40e1-b420-3c53d41f2558 req-4c22811a-c786-4a81-b907-5ab8172cb410 tempest-TaggedAttachmentsTest-1907644880 None] Terminate volume connection completed successfully. Jul 28 14:28:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-5334a3f2-c877-40e1-b420-3c53d41f2558 req-4c22811a-c786-4a81-b907-5ab8172cb410 tempest-TaggedAttachmentsTest-1907644880 None] Deleting attachment 68478e4a-e99d-4ce7-b9a5-7c8032f2b274. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (f70bfac9-063f-4dd8-a8e4-9efb390a6ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9a0b2c-47fa-4322-8d9a-118cb2f797eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9a0b2c-47fa-4322-8d9a-118cb2f797eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720025139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2661f09-090c-49e1-b98f-4178d40d7657,host='devstack@QuobyteHD#QuobyteHD',id=0522dc73-2c70-42de-b602-442d2160d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:44Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c1fa33-98e2-4eec-825f-5c261b2d7548),volume_type_id=54c1fa33-98e2-4eec-825f-5c261b2d7548)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa8ff9d-3b5a-4858-8df0-034ab2682a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa8ff9d-3b5a-4858-8df0-034ab2682a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa5ec6d-0da8-41a1-a4e2-1f898e76f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa5ec6d-0da8-41a1-a4e2-1f898e76f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0522dc73-2c70-42de-b602-442d2160d602', 'volume_name': 'volume-0522dc73-2c70-42de-b602-442d2160d602', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51959e7a-b062-4124-b592-219c1f701b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51959e7a-b062-4124-b592-219c1f701b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bb22e-7370-4acf-b8f3-aa3e48b35427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:44 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Volume 0522dc73-2c70-42de-b602-442d2160d602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0522dc73-2c70-42de-b602-442d2160d602', 'volume_size': 1} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2661f09-090c-49e1-b98f-4178d40d7657,created_at=2026-07-28T12:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720025139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2661f09-090c-49e1-b98f-4178d40d7657,host='devstack@QuobyteHD#QuobyteHD',id=0522dc73-2c70-42de-b602-442d2160d602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b282f4a70f48309d094b5114edfa5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:44Z,use_quota=True,user_id='9fa032b5a4d6473d87b6808e41092d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54c1fa33-98e2-4eec-825f-5c261b2d7548),volume_type_id=54c1fa33-98e2-4eec-825f-5c261b2d7548)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Creating volume 0522dc73-2c70-42de-b602-442d2160d602 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:28:44 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:28:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:44 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 1073741824 Jul 28 14:28:44 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:45 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 1073741824" returned: 0 in 0.699s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:45 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 Jul 28 14:28:45 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (25f23df8-8c6f-496c-9f5f-b490d75dad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e87bdd-3dfb-40af-b257-2d451ce38fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e87bdd-3dfb-40af-b257-2d451ce38fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-9668425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ea67d5-6880-4144-a529-f0c9c9f09ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:45Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f977178-4858-4262-8a37-5202519ea74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f977178-4858-4262-8a37-5202519ea74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db667ced-a916-46c8-bdea-72479b41028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db667ced-a916-46c8-bdea-72479b41028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ea67d5-6880-4144-a529-f0c9c9f09ffd', 'volume_name': 'volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e2739f-8466-4df0-9aef-7ce92e509320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e2739f-8466-4df0-9aef-7ce92e509320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39090a50-66da-424a-8215-192209b1769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Volume 38ea67d5-6880-4144-a529-f0c9c9f09ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd', 'volume_size': 1} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:45 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-9668425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ea67d5-6880-4144-a529-f0c9c9f09ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:28:45Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Creating volume 38ea67d5-6880-4144-a529-f0c9c9f09ffd {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:28:45 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:45 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd 1073741824 Jul 28 14:28:45 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bb22e-7370-4acf-b8f3-aa3e48b35427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0522dc73-2c70-42de-b602-442d2160d602', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c637087-5fd6-437c-8725-2b91bfd3ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Volume volume-0522dc73-2c70-42de-b602-442d2160d602 (0522dc73-2c70-42de-b602-442d2160d602): created successfully Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c637087-5fd6-437c-8725-2b91bfd3ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Flow 'volume_create_manager' (f70bfac9-063f-4dd8-a8e4-9efb390a6ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6056d399-6a14-4888-ad70-576addb271e0 tempest-GroupsTest-416931564 None] Created volume successfully. Jul 28 14:28:46 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd 1073741824" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:46 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd Jul 28 14:28:46 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:46 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39090a50-66da-424a-8215-192209b1769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dee8c1-e8a4-4251-b762-f3805c81198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:28:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Volume volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd (38ea67d5-6880-4144-a529-f0c9c9f09ffd): created successfully Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dee8c1-e8a4-4251-b762-f3805c81198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:28:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (25f23df8-8c6f-496c-9f5f-b490d75dad1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:28:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d9ee6417-9a28-4925-8bb8-468dc35701d1 tempest-AttachVolumeNegativeTest-221585927 None] Created volume successfully. Jul 28 14:28:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d803e35c-d67e-4e03-bfdd-d7cafde29fff tempest-GroupsTest-416931564 None] Update group completed successfully. Jul 28 14:28:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-14d63b78-208f-457d-a20d-865f39f6ba4c req-81cb103d-ae5f-44ea-83a1-65d14a72222d tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-14d63b78-208f-457d-a20d-865f39f6ba4c req-81cb103d-ae5f-44ea-83a1-65d14a72222d tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-14d63b78-208f-457d-a20d-865f39f6ba4c req-81cb103d-ae5f-44ea-83a1-65d14a72222d tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-14d63b78-208f-457d-a20d-865f39f6ba4c req-81cb103d-ae5f-44ea-83a1-65d14a72222d tempest-AttachVolumeNegativeTest-221585927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ac43142-055e-4b37-84e7-0500de2ef1f2', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:28:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-14d63b78-208f-457d-a20d-865f39f6ba4c req-81cb103d-ae5f-44ea-83a1-65d14a72222d tempest-AttachVolumeNegativeTest-221585927 None] attachment_update completed successfully. Jul 28 14:28:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b8092e2c-dd61-402d-852e-1d46859c1106 tempest-GroupsTest-416931564 None] Update group completed successfully. Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:49 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:49 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:49 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.513s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 8 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:28:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:28:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Acquiring lock "cinder-quobyte-0522dc73-2c70-42de-b602-442d2160d602" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-0522dc73-2c70-42de-b602-442d2160d602" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae0172-4c0f-4dc9-ab2b-1573237d5a2b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:51 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 Jul 28 14:28:51 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:51 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602" returned: 0 in 0.528s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:51 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602 Jul 28 14:28:51 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-cae5e63b-5353-4491-a644-9ad26469463e req-765b0a38-7999-4ef9-bb1a-a2ba70c2fa97 tempest-AttachVolumeNegativeTest-221585927 None] Terminate volume connection completed successfully. Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-cae5e63b-5353-4491-a644-9ad26469463e req-765b0a38-7999-4ef9-bb1a-a2ba70c2fa97 tempest-AttachVolumeNegativeTest-221585927 None] Deleting attachment 6ac43142-055e-4b37-84e7-0500de2ef1f2. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:28:51 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0522dc73-2c70-42de-b602-442d2160d602" returned: 0 in 0.325s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-0522dc73-2c70-42de-b602-442d2160d602" released by "delete_volume" :: held 0.940s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Acquiring lock "cinder-quobyte-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842aa4d-4575-48c3-b89d-ade61e940a12]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:52 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa Jul 28 14:28:52 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:52 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" returned: 0 in 0.526s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:52 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa Jul 28 14:28:52 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:52 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "cinder-quobyte-e52e18b8-85a1-4a9b-8aa8-ef82fb9140fa" released by "delete_volume" :: held 0.993s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Created reservations ['9e74270a-b092-46ac-b2df-cf2c6fd8ff98'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:53 devstack cinder-volume[87385]: WARNING cinder.quota [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-5402967 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-5402967, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:28:53 devstack cinder-volume[87385]: WARNING cinder.quota [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-5402967 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-5402967, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "cinder-045cf323-708f-4873-b38e-e6c6a828811d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "cinder-045cf323-708f-4873-b38e-e6c6a828811d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Created reservations ['30a5f1f9-f110-423b-b6d2-bd21c745d4a0', '9ff6a5d6-10d1-494f-9d1a-5d7050b71ba4', '3ef209ad-bca7-402a-91f1-5e4af8659766', 'baf79a35-3ed7-4063-97af-5e5d0cdfddfb'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "cinder-quobyte-045cf323-708f-4873-b38e-e6c6a828811d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "cinder-quobyte-045cf323-708f-4873-b38e-e6c6a828811d" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee48eb-c42f-432c-895f-823f189314f7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Created reservations ['97b6de52-c35d-4f76-bd08-bda9053f2793', '718f285d-823e-41f7-a6dd-7bfb10c99cf2', '9d02d534-f814-4754-bbe6-b471774c65f5', '9e10090c-dcd7-40bb-b2b2-46bd05f1be82'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:53 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d Jul 28 14:28:53 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:53 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:53 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:53 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d" returned: 0 in 0.641s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:53 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:53 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-da61f0f5-53f6-4155-a1e0-d0445f7000cb tempest-GroupsTest-416931564 None] Delete group completed successfully. Jul 28 14:28:54 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d Jul 28 14:28:54 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:54 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-045cf323-708f-4873-b38e-e6c6a828811d" returned: 0 in 0.439s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "cinder-quobyte-045cf323-708f-4873-b38e-e6c6a828811d" released by "delete_volume" :: held 1.144s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Created reservations ['178ab6bd-200c-4736-bb1e-04d9687998b6', '6c3a585c-ac01-451f-b9b6-56dacf437707', '8197cfd0-e3f8-48c2-8130-5d7fe1a470b6', '34f1e4a9-dfd1-4c9c-a724-e4f6a64802f0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:28:54 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:28:54 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:28:54 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:28:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Deleted volume successfully. Jul 28 14:28:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b4c6f3f-c279-4790-95c5-cfff7c1f89da tempest-TaggedAttachmentsTest-1907644880 None] Lock "cinder-045cf323-708f-4873-b38e-e6c6a828811d-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7f450c49-b314-4227-a895-1ae421586f3e tempest-GroupsV314Test-137848713 None] Group tempest-GroupsV314Test-Group-248915277: creating Jul 28 14:29:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7f450c49-b314-4227-a895-1ae421586f3e tempest-GroupsV314Test-137848713 None] Group tempest-GroupsV314Test-Group-248915277: created successfully Jul 28 14:29:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7f450c49-b314-4227-a895-1ae421586f3e tempest-GroupsV314Test-137848713 None] Create group completed successfully. Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Flow 'volume_create_manager' (31e46d52-179a-448e-8c4a-4eb6f0da5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443ab6e7-ed67-4563-994f-b4c9663af2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443ab6e7-ed67-4563-994f-b4c9663af2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1904355080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9239d6be-1cd8-4a33-a515-652d513678b1,host='devstack@QuobyteHD#QuobyteHD',id=81f916b5-b2d8-4bce-8062-66f79e117c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410b10460324258bc0711dce587be51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:05Z,use_quota=True,user_id='276f39013ae24187a932698c568d552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cadbe10f-c81c-42bb-b66c-5c196043da2b),volume_type_id=cadbe10f-c81c-42bb-b66c-5c196043da2b)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6a1a47-d309-4b25-87be-accd7a0da8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6a1a47-d309-4b25-87be-accd7a0da8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844d5154-124a-4f63-9ea4-b956b565d1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844d5154-124a-4f63-9ea4-b956b565d1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f916b5-b2d8-4bce-8062-66f79e117c92', 'volume_name': 'volume-81f916b5-b2d8-4bce-8062-66f79e117c92', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ba296-4cf7-43ab-80f0-2f65a04ea63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ba296-4cf7-43ab-80f0-2f65a04ea63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ef29f-c9f9-40bf-b7f2-f7b6980097f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Volume 81f916b5-b2d8-4bce-8062-66f79e117c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f916b5-b2d8-4bce-8062-66f79e117c92', 'volume_size': 1} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9239d6be-1cd8-4a33-a515-652d513678b1,created_at=2026-07-28T12:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1904355080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9239d6be-1cd8-4a33-a515-652d513678b1,host='devstack@QuobyteHD#QuobyteHD',id=81f916b5-b2d8-4bce-8062-66f79e117c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410b10460324258bc0711dce587be51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:05Z,use_quota=True,user_id='276f39013ae24187a932698c568d552e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cadbe10f-c81c-42bb-b66c-5c196043da2b),volume_type_id=cadbe10f-c81c-42bb-b66c-5c196043da2b)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Creating volume 81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:29:05 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:29:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:05 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 1073741824 Jul 28 14:29:05 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:06 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 1073741824" returned: 0 in 0.733s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:06 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:06 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:06 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3ef29f-c9f9-40bf-b7f2-f7b6980097f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f916b5-b2d8-4bce-8062-66f79e117c92', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d1a203-ab7d-41b6-a461-bba7a3ed3fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Volume volume-81f916b5-b2d8-4bce-8062-66f79e117c92 (81f916b5-b2d8-4bce-8062-66f79e117c92): created successfully Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d1a203-ab7d-41b6-a461-bba7a3ed3fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Flow 'volume_create_manager' (31e46d52-179a-448e-8c4a-4eb6f0da5708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-80abe5c6-49c6-41c3-a228-38ba538f3f56 tempest-GroupsV314Test-137848713 None] Created volume successfully. Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:09 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Cloning volume 81f916b5-b2d8-4bce-8062-66f79e117c92 to volume 3d96baac-7239-4237-afa4-2c0d639af366 Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Creating offline snapshot e3bf04c5-fcd9-4b98-a221-fe758a460bbb of volume 81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba789c-378a-4704-aea7-3a0f9c63db2d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:09 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:09 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:09 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.786s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:09 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb 1G Jul 28 14:29:09 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:10 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb 1G" returned: 0 in 0.552s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f916b5-b2d8-4bce-8062-66f79e117c92 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:10 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f916b5-b2d8-4bce-8062-66f79e117c92 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:10 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:11 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f916b5-b2d8-4bce-8062-66f79e117c92 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.562s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:11 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:29:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:11 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:11 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:11 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.527s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:11 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info Jul 28 14:29:11 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:12 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info" returned: 0 in 0.894s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:12 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:29:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:12 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info Jul 28 14:29:12 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.info" returned: 0 in 0.737s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:13 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Acquiring lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] snapshot: e3bf04c5-fcd9-4b98-a221-fe758a460bbb, volume: 3d96baac-7239-4237-afa4-2c0d639af366, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3ab67-e504-4e16-98b7-42fe046cac0c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:13 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:13 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:14 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.865s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81f916b5-b2d8-4bce-8062-66f79e117c92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ddaec8-2956-45cf-a787-7c54da5ef8bb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:14 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:14 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:15 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.655s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:15 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:29:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:15 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 Jul 28 14:29:15 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:21 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=70,cinder:UPDATE=77,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:29:21 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=86,cinder:INSERT=16,cinder:UPDATE=67,cinder:DELETE=2 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:29:24 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366" returned: 0 in 9.535s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c2a06-4589-4d5b-829f-d04330a30a0f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:24 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:24 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:25 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 1.101s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:25 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92, size 1024.00 MB, duration 9.54 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:29:25 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Converted 1024.00 MB image at 107.38 MB/s Jul 28 14:29:25 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:29:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:25 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 Jul 28 14:29:25 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:26 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" released by "_copy_volume_from_snapshot" :: held 12.783s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Acquiring lock "cinder-quobyte-e3bf04c5-fcd9-4b98-a221-fe758a460bbb" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-e3bf04c5-fcd9-4b98-a221-fe758a460bbb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Deleting offline snapshot e3bf04c5-fcd9-4b98-a221-fe758a460bbb of volume 81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] snapshot_file for this snap is: volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[66217edc-1657-46cc-8281-7dd70a6be5dc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:26 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:26 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:26 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.547s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81f916b5-b2d8-4bce-8062-66f79e117c92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783ffdb-b732-419e-a16c-97d96302dec0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:27 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:27 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:27 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.728s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:27 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:27 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:28 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.497s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:28 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb Jul 28 14:29:28 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:28 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92.e3bf04c5-fcd9-4b98-a221-fe758a460bbb" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-e3bf04c5-fcd9-4b98-a221-fe758a460bbb" released by "_delete_snapshot" :: held 2.170s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.472s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-66145ce0-eb67-4404-b18e-729977a7e4e4 tempest-GroupsV314Test-137848713 None] Create group from source-group-9239d6be-1cd8-4a33-a515-652d513678b1 completed successfully. Jul 28 14:29:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Acquiring lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae6f606-de48-4557-8fd6-1b4ce4506206]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:30 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 Jul 28 14:29:30 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:31 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366" returned: 0 in 0.729s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:31 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366 Jul 28 14:29:31 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:31 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3d96baac-7239-4237-afa4-2c0d639af366" returned: 0 in 0.454s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-3d96baac-7239-4237-afa4-2c0d639af366" released by "delete_volume" :: held 1.279s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Created reservations ['821ad72e-c523-4faf-8ab8-05ea21a559f4'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:31 devstack cinder-volume[87385]: WARNING cinder.quota [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-69433892 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-69433892, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:29:31 devstack cinder-volume[87385]: WARNING cinder.quota [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-69433892 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-69433892, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:29:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Created reservations ['1f78d499-9d7e-4b90-bcb4-cadf58b617cb', 'fe6a3f03-6234-4023-a9cb-71624b7cf1bf', '20b8f261-85a4-4e04-a926-8aadbab1708f', 'c7287fd6-39ea-4e9d-a1db-c46f0027c76d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:32 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:32 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:32 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-36dad82b-593c-4367-84cb-c733a7eb7d20 tempest-GroupsV314Test-137848713 None] Delete group completed successfully. Jul 28 14:29:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Acquiring lock "cinder-quobyte-81f916b5-b2d8-4bce-8062-66f79e117c92" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-81f916b5-b2d8-4bce-8062-66f79e117c92" acquired by "delete_volume" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff61b1-d5ca-4454-a904-36dea6a0214d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:33 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:33 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:34 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.755s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:34 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92 Jul 28 14:29:34 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:34 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81f916b5-b2d8-4bce-8062-66f79e117c92" returned: 0 in 0.468s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Lock "cinder-quobyte-81f916b5-b2d8-4bce-8062-66f79e117c92" released by "delete_volume" :: held 1.352s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:34 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Created reservations ['d1ec99f6-9177-4b7b-bdb6-a3d1776377e7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Created reservations ['5abd4c47-b0a0-4684-88af-5af42cb9f7a1', '1465792e-4d9e-47d2-a2b9-b9008907de00', '7c47f94d-29bd-4852-943e-231819f320c4', 'fd702625-91bd-4704-9987-837f050071f5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:35 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:35 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:35 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.456s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:35 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-58b2cd61-ba11-42ac-9890-ed48cde4d1f8 tempest-GroupsV314Test-137848713 None] Delete group completed successfully. Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Flow 'volume_create_manager' (1c8b6377-4787-4f0b-a08c-319f8266136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8c6b4f-bc1d-4c9b-b799-8d7f7ae0f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8c6b4f-bc1d-4c9b-b799-8d7f7ae0f378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-603913262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9c421f-2d44-485e-9fb3-584ebef4c352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964443ec6bc34b0d95897578fd5e6771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:39Z,use_quota=True,user_id='4e1195cde52746b9a43c754f3555783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83a68b-0cd4-4ba6-8ca7-6bc6ebaefb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83a68b-0cd4-4ba6-8ca7-6bc6ebaefb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5bafc-630e-48ee-a086-37107bd76572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5bafc-630e-48ee-a086-37107bd76572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9c421f-2d44-485e-9fb3-584ebef4c352', 'volume_name': 'volume-ed9c421f-2d44-485e-9fb3-584ebef4c352', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c158e78-d242-4cf3-b752-cc62beb58bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c158e78-d242-4cf3-b752-cc62beb58bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c26c6d0-6921-4320-934a-18bf3b8ad4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:39 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Volume ed9c421f-2d44-485e-9fb3-584ebef4c352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9c421f-2d44-485e-9fb3-584ebef4c352', 'volume_size': 1} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-603913262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9c421f-2d44-485e-9fb3-584ebef4c352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964443ec6bc34b0d95897578fd5e6771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:39Z,use_quota=True,user_id='4e1195cde52746b9a43c754f3555783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Creating volume ed9c421f-2d44-485e-9fb3-584ebef4c352 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:29:39 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:39 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 1073741824 Jul 28 14:29:39 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:39 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 1073741824" returned: 0 in 0.548s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:40 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 Jul 28 14:29:40 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:40 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352" returned: 0 in 0.373s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c26c6d0-6921-4320-934a-18bf3b8ad4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9c421f-2d44-485e-9fb3-584ebef4c352', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4924d0-583e-451a-bb25-b422336dda25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (0a0465fe-375d-4ab8-a74e-e7eb2067e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5e5b79-f4e9-4725-aab2-c0033d85b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Volume volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 (ed9c421f-2d44-485e-9fb3-584ebef4c352): created successfully Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4924d0-583e-451a-bb25-b422336dda25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Flow 'volume_create_manager' (1c8b6377-4787-4f0b-a08c-319f8266136a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5e5b79-f4e9-4725-aab2-c0033d85b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-151236180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ccbe4-3728-46de-9d41-5f58b7439787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:40Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ab6cb6-ef5c-4b27-938a-4d28f8ece19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ab6cb6-ef5c-4b27-938a-4d28f8ece19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e38f1e9-9e3c-44ce-82c3-310c3b676b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e38f1e9-9e3c-44ce-82c3-310c3b676b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3ccbe4-3728-46de-9d41-5f58b7439787', 'volume_name': 'volume-ad3ccbe4-3728-46de-9d41-5f58b7439787', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46c1b69-8914-4657-b967-1c2e49f21eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46c1b69-8914-4657-b967-1c2e49f21eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ba6ab4-2361-4724-8387-c0ea354f41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Volume ad3ccbe4-3728-46de-9d41-5f58b7439787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3ccbe4-3728-46de-9d41-5f58b7439787', 'volume_size': 1} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-151236180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ccbe4-3728-46de-9d41-5f58b7439787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e03d90362b0451a89878ebdb8611dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:40Z,use_quota=True,user_id='10665a3df5cd47b1b4c52569a33fa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Creating volume ad3ccbe4-3728-46de-9d41-5f58b7439787 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:29:40 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:29:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-91b4c53e-e162-4066-9669-a4cbeceed613 tempest-ServersNegativeTestJSON-331024259 None] Created volume successfully. Jul 28 14:29:40 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 1073741824 Jul 28 14:29:40 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:41 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 1073741824" returned: 0 in 0.616s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:41 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 Jul 28 14:29:41 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:41 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787" returned: 0 in 0.422s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ba6ab4-2361-4724-8387-c0ea354f41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3ccbe4-3728-46de-9d41-5f58b7439787', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa077e6-8243-4170-a900-1dd3deff4e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Volume volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 (ad3ccbe4-3728-46de-9d41-5f58b7439787): created successfully Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa077e6-8243-4170-a900-1dd3deff4e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Flow 'volume_create_manager' (0a0465fe-375d-4ab8-a74e-e7eb2067e902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-57c3208f-aeba-453c-8b49-1777bf6a27ed tempest-AttachVolumeNegativeTest-221585927 None] Created volume successfully. Jul 28 14:29:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4dfd3def-1891-454e-871e-b12d5fecf254 tempest-GroupsV320Test-59321728 None] Group tempest-GroupsV320Test-Group-713645131: creating Jul 28 14:29:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4dfd3def-1891-454e-871e-b12d5fecf254 tempest-GroupsV320Test-59321728 None] Group tempest-GroupsV320Test-Group-713645131: created successfully Jul 28 14:29:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4dfd3def-1891-454e-871e-b12d5fecf254 tempest-GroupsV320Test-59321728 None] Create group completed successfully. Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Flow 'volume_create_manager' (fe78b7c3-8066-4d67-9d16-6fd224f9ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698397c3-e249-4a56-b096-6214772a85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698397c3-e249-4a56-b096-6214772a85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1638988307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60547eef-27a2-4faf-8b40-ec4b098216bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964443ec6bc34b0d95897578fd5e6771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:44Z,use_quota=True,user_id='4e1195cde52746b9a43c754f3555783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c265be12-2dce-446f-95e9-93733ef283c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c265be12-2dce-446f-95e9-93733ef283c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e25a8c8-aecf-4bb1-8210-43797c3f2e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e25a8c8-aecf-4bb1-8210-43797c3f2e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60547eef-27a2-4faf-8b40-ec4b098216bc', 'volume_name': 'volume-60547eef-27a2-4faf-8b40-ec4b098216bc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f66f2d4-52f6-4acb-9f39-37ed050667aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f66f2d4-52f6-4acb-9f39-37ed050667aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7046989-fcc6-419e-b413-172cfdd2ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:44 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Volume 60547eef-27a2-4faf-8b40-ec4b098216bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60547eef-27a2-4faf-8b40-ec4b098216bc', 'volume_size': 1} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1638988307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60547eef-27a2-4faf-8b40-ec4b098216bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='964443ec6bc34b0d95897578fd5e6771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:29:44Z,use_quota=True,user_id='4e1195cde52746b9a43c754f3555783c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Creating volume 60547eef-27a2-4faf-8b40-ec4b098216bc {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:29:44 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:44 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc 1073741824 Jul 28 14:29:44 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-137591f9-dbce-48f4-bf37-dc0edd61cf1a req-f648f6dc-65ea-436c-8804-c844dd203fe9 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:44 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc 1073741824" returned: 0 in 0.799s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:44 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc Jul 28 14:29:44 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:45 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc" returned: 0 in 0.523s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-137591f9-dbce-48f4-bf37-dc0edd61cf1a req-f648f6dc-65ea-436c-8804-c844dd203fe9 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.893s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7046989-fcc6-419e-b413-172cfdd2ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60547eef-27a2-4faf-8b40-ec4b098216bc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e8059a-ba47-4ee8-9514-25d3da09c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-137591f9-dbce-48f4-bf37-dc0edd61cf1a req-f648f6dc-65ea-436c-8804-c844dd203fe9 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Volume volume-60547eef-27a2-4faf-8b40-ec4b098216bc (60547eef-27a2-4faf-8b40-ec4b098216bc): created successfully Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e8059a-ba47-4ee8-9514-25d3da09c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Flow 'volume_create_manager' (fe78b7c3-8066-4d67-9d16-6fd224f9ff58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-137591f9-dbce-48f4-bf37-dc0edd61cf1a req-f648f6dc-65ea-436c-8804-c844dd203fe9 tempest-AttachVolumeNegativeTest-221585927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-ad3ccbe4-3728-46de-9d41-5f58b7439787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6615e7f5-ea52-4cff-bc3a-204c485397a7', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:29:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6dcf531f-91bf-4c9a-acc0-13de8a54b62f tempest-ServersNegativeTestJSON-331024259 None] Created volume successfully. Jul 28 14:29:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-137591f9-dbce-48f4-bf37-dc0edd61cf1a req-f648f6dc-65ea-436c-8804-c844dd203fe9 tempest-AttachVolumeNegativeTest-221585927 None] attachment_update completed successfully. Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Created reservations ['b33ee16f-9a5d-4960-9381-735dea0372af'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:45 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:45 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:46 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:46 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2aca19aa-1078-4cb7-b287-7414ad65374b tempest-GroupsV320Test-59321728 None] Delete group completed successfully. Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "cinder-60547eef-27a2-4faf-8b40-ec4b098216bc-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-60547eef-27a2-4faf-8b40-ec4b098216bc-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "cinder-quobyte-60547eef-27a2-4faf-8b40-ec4b098216bc" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-quobyte-60547eef-27a2-4faf-8b40-ec4b098216bc" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e12f9-49ca-4378-b98c-2d17209ced6d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:47 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc Jul 28 14:29:47 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:48 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc" returned: 0 in 0.683s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:48 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc Jul 28 14:29:48 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:48 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-60547eef-27a2-4faf-8b40-ec4b098216bc" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-quobyte-60547eef-27a2-4faf-8b40-ec4b098216bc" released by "delete_volume" :: held 1.196s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:48 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Created reservations ['1e1b60cc-388d-4944-81b7-5b5497998651', 'a0f5cf47-bc9e-421d-9549-18e7fdbcf735', '279a369f-bf7d-4a11-9830-723481607855', '421b304a-38dd-4030-b548-ceb4152d9fc6'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:49 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:49 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:49 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:49 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:49 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.680s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Deleted volume successfully. Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "cinder-ed9c421f-2d44-485e-9fb3-584ebef4c352-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21407342-5efa-4c0f-9cc7-99abed5424e0 tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-60547eef-27a2-4faf-8b40-ec4b098216bc-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-ed9c421f-2d44-485e-9fb3-584ebef4c352-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "cinder-quobyte-ed9c421f-2d44-485e-9fb3-584ebef4c352" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:29:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-quobyte-ed9c421f-2d44-485e-9fb3-584ebef4c352" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:29:50 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69449e-fdb0-4887-a74a-c3d29f7758ef]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.933s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 8 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:29:50 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 Jul 28 14:29:50 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:50 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352" returned: 0 in 0.879s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:51 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352 Jul 28 14:29:51 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-a94a44ae-6bf1-4be0-baaa-5c080c79f665 req-51adc83f-69b6-4eec-8e92-aba50867c3da tempest-AttachVolumeNegativeTest-221585927 None] Terminate volume connection completed successfully. Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-a94a44ae-6bf1-4be0-baaa-5c080c79f665 req-51adc83f-69b6-4eec-8e92-aba50867c3da tempest-AttachVolumeNegativeTest-221585927 None] Deleting attachment 6615e7f5-ea52-4cff-bc3a-204c485397a7. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:29:51 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ed9c421f-2d44-485e-9fb3-584ebef4c352" returned: 0 in 0.554s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-quobyte-ed9c421f-2d44-485e-9fb3-584ebef4c352" released by "delete_volume" :: held 1.561s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Created reservations ['040eef4c-f95d-44cc-9eed-8df5a77e1710', '05b32b6c-8efd-43e9-aaad-17dfbbaf502b', '472c0d8d-e431-44ac-89a5-d1e3aab9ef3c', '61977dfd-b52a-4f05-8940-5e84dc1474a5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:29:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:29:51 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:29:51 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:29:52 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 28 14:29:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.407s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:29:52 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:29:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Deleted volume successfully. Jul 28 14:29:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d7ba2425-4527-456a-a4f7-d62ceeb7660e tempest-ServersNegativeTestJSON-331024259 None] Lock "cinder-ed9c421f-2d44-485e-9fb3-584ebef4c352-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:01 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=53,cinder:SELECT=45,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:30:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-ad3ccbe4-3728-46de-9d41-5f58b7439787-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-ad3ccbe4-3728-46de-9d41-5f58b7439787-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-quobyte-ad3ccbe4-3728-46de-9d41-5f58b7439787" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-ad3ccbe4-3728-46de-9d41-5f58b7439787" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[061576e6-4eb9-4b74-bd60-458c0303af4b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:02 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 Jul 28 14:30:02 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:02 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787" returned: 0 in 0.641s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:02 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787 Jul 28 14:30:02 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:03 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3ccbe4-3728-46de-9d41-5f58b7439787" returned: 0 in 0.509s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-ad3ccbe4-3728-46de-9d41-5f58b7439787" released by "delete_volume" :: held 1.248s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Created reservations ['73f5f7b4-5857-495b-af60-1b6155057ce9', '39de18ca-32a9-4e04-ab95-871e676b6be6', 'dfd036b7-d73d-4ef5-8d5d-4f73c9a72e00', '7f3248ac-6c5a-4f2e-bbb9-31afea958181'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:03 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:03 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:03 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.417s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Deleted volume successfully. Jul 28 14:30:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c36009fd-988d-4bbe-a264-6c0adb8fd6f5 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-ad3ccbe4-3728-46de-9d41-5f58b7439787-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-38ea67d5-6880-4144-a529-f0c9c9f09ffd-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-38ea67d5-6880-4144-a529-f0c9c9f09ffd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-quobyte-38ea67d5-6880-4144-a529-f0c9c9f09ffd" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-38ea67d5-6880-4144-a529-f0c9c9f09ffd" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2425490-0717-43be-a9c5-46e0f6d97975]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:04 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd Jul 28 14:30:04 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:05 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd" returned: 0 in 0.589s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:05 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd Jul 28 14:30:05 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:05 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-38ea67d5-6880-4144-a529-f0c9c9f09ffd" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-38ea67d5-6880-4144-a529-f0c9c9f09ffd" released by "delete_volume" :: held 1.079s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Created reservations ['487f5414-5b66-4b49-b5dd-fcc68fd9d6e3', '1a33976e-c057-40d8-a183-36ca95286058', '04682fc5-0ab3-42ac-833f-801d9b99a522', 'd93deabb-907f-4ed3-8daa-decd64a5febf'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:05 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:05 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:06 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.344s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:06 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Deleted volume successfully. Jul 28 14:30:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-71ac4e1d-8b13-45e7-a350-c9d3cd1dcf15 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-38ea67d5-6880-4144-a529-f0c9c9f09ffd-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-55685a8d-d2a3-40d2-80f4-9272006e3908-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-55685a8d-d2a3-40d2-80f4-9272006e3908-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "cinder-quobyte-55685a8d-d2a3-40d2-80f4-9272006e3908" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-55685a8d-d2a3-40d2-80f4-9272006e3908" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0344939b-70e8-49b1-86a5-76513b54d647]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:07 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 Jul 28 14:30:07 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:07 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908" returned: 0 in 0.506s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:07 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908 Jul 28 14:30:07 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:08 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-55685a8d-d2a3-40d2-80f4-9272006e3908" returned: 0 in 0.414s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-quobyte-55685a8d-d2a3-40d2-80f4-9272006e3908" released by "delete_volume" :: held 1.008s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Created reservations ['0d7976ca-c33e-4691-a435-14553d07e53d', '4621fcc8-7905-48c6-bfcd-ad4ef912953f', 'dc38c408-3614-42f1-b7cd-a7ebc889f1cc', '1e124314-7044-446c-959c-df2f99bd6890'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:08 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:08 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Flow 'volume_create_manager' (e0ac2019-be3c-4f92-a97b-5d7fec67d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1905c0-94cb-4d7e-a008-9edc154c3c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1905c0-94cb-4d7e-a008-9edc154c3c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1728136319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f6c12f-d013-4eb0-bc05-ea51885c8f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633a908925844a31b36f666325c26527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:09Z,use_quota=True,user_id='a3317f0a8f8c4e6aa1552d3393e3ebe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1006127-0e9c-4940-aa17-c35733b99e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1006127-0e9c-4940-aa17-c35733b99e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23aeeec2-a07a-48b6-b115-217ae9491167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23aeeec2-a07a-48b6-b115-217ae9491167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f6c12f-d013-4eb0-bc05-ea51885c8f52', 'volume_name': 'volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cfe62-7061-4a96-8827-dcd9618cca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cfe62-7061-4a96-8827-dcd9618cca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f472a5-2abf-4e66-936a-049780e4f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:08 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Volume 52f6c12f-d013-4eb0-bc05-ea51885c8f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52', 'volume_size': 1} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1728136319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f6c12f-d013-4eb0-bc05-ea51885c8f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633a908925844a31b36f666325c26527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:09Z,use_quota=True,user_id='a3317f0a8f8c4e6aa1552d3393e3ebe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Creating volume 52f6c12f-d013-4eb0-bc05-ea51885c8f52 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:30:08 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:30:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:09 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 1073741824 Jul 28 14:30:09 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:09 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.338s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Deleted volume successfully. Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7c443bea-b9c6-4a58-8f04-6a2256caaa03 tempest-AttachVolumeNegativeTest-221585927 None] Lock "cinder-55685a8d-d2a3-40d2-80f4-9272006e3908-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:09 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 1073741824" returned: 0 in 0.598s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:09 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 Jul 28 14:30:09 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:09 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52" returned: 0 in 0.355s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f472a5-2abf-4e66-936a-049780e4f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13507381-d14b-4f3f-b259-27f3e7a492ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:09 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Volume volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 (52f6c12f-d013-4eb0-bc05-ea51885c8f52): created successfully Jul 28 14:30:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13507381-d14b-4f3f-b259-27f3e7a492ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Flow 'volume_create_manager' (e0ac2019-be3c-4f92-a97b-5d7fec67d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d7ed2e0d-b34c-468e-8733-51cc39d25cbf tempest-ServerRescueNegativeTestJSON-999192864 None] Created volume successfully. Jul 28 14:30:19 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=84,cinder:SELECT=68,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:30:20 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=18,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Flow 'volume_create_manager' (e9869f74-8652-44ac-b41b-829ceefb5aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36622278-43da-4157-af92-b91b415ee941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36622278-43da-4157-af92-b91b415ee941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1355099675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79e55d-4e1f-4b7b-972f-c2d70a166711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25aae4dea720428abedd542c44a53dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:22Z,use_quota=True,user_id='8cc65ebadfe8407f857204c8a787132e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83aad38-9670-457d-b315-ff45e62b4fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83aad38-9670-457d-b315-ff45e62b4fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fd4a76-b1b2-4ed0-98b6-facf102d5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fd4a76-b1b2-4ed0-98b6-facf102d5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb79e55d-4e1f-4b7b-972f-c2d70a166711', 'volume_name': 'volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f84181-7826-4fa3-b337-b372da7959d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f84181-7826-4fa3-b337-b372da7959d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fb289e-dc9f-4b99-9435-f9b8ae285a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:22 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Volume eb79e55d-4e1f-4b7b-972f-c2d70a166711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711', 'volume_size': 1} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1355099675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb79e55d-4e1f-4b7b-972f-c2d70a166711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25aae4dea720428abedd542c44a53dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:22Z,use_quota=True,user_id='8cc65ebadfe8407f857204c8a787132e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Creating volume eb79e55d-4e1f-4b7b-972f-c2d70a166711 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:30:22 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:30:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:22 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 1073741824 Jul 28 14:30:22 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:23 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 1073741824" returned: 0 in 0.877s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:23 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 Jul 28 14:30:23 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:23 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:30:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fb289e-dc9f-4b99-9435-f9b8ae285a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80874a21-351c-41d1-976e-45ee2be8ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Volume volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 (eb79e55d-4e1f-4b7b-972f-c2d70a166711): created successfully Jul 28 14:30:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80874a21-351c-41d1-976e-45ee2be8ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Flow 'volume_create_manager' (e9869f74-8652-44ac-b41b-829ceefb5aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-d4b2a288-63ae-444a-b4cf-fe8c0ae75d61 req-dc2d2c8f-250c-4a11-9243-07760fc3708c tempest-VolumesGetTestJSON-1952615897 None] Created volume successfully. Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Acquiring lock "cinder-eb79e55d-4e1f-4b7b-972f-c2d70a166711-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "cinder-eb79e55d-4e1f-4b7b-972f-c2d70a166711-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Acquiring lock "cinder-quobyte-eb79e55d-4e1f-4b7b-972f-c2d70a166711" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "cinder-quobyte-eb79e55d-4e1f-4b7b-972f-c2d70a166711" acquired by "delete_volume" :: waited 0.044s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d5e69-ab29-4a47-9649-e6a31e8ab1be]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:25 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 Jul 28 14:30:25 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:25 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711" returned: 0 in 0.530s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:25 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711 Jul 28 14:30:25 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:26 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb79e55d-4e1f-4b7b-972f-c2d70a166711" returned: 0 in 0.335s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "cinder-quobyte-eb79e55d-4e1f-4b7b-972f-c2d70a166711" released by "delete_volume" :: held 0.945s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.quota [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Created reservations ['62ed8acd-3d45-428a-b4b6-ff321eceb572', 'b3c39b73-f466-4e11-b515-eb0497ad20d2', 'fde57a06-c940-486d-8c96-604c1505fc42', '8464924f-a574-49fd-90a0-217bac47b243'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:26 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:26 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:26 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.manager [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Deleted volume successfully. Jul 28 14:30:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-613791a1-7cf4-4475-93af-a61eed15ae74 req-f5a05fd4-e013-4267-a948-ff048f2aa95a tempest-VolumesGetTestJSON-1952615897 None] Lock "cinder-eb79e55d-4e1f-4b7b-972f-c2d70a166711-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Acquiring lock "cinder-52f6c12f-d013-4eb0-bc05-ea51885c8f52-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "cinder-52f6c12f-d013-4eb0-bc05-ea51885c8f52-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Acquiring lock "cinder-quobyte-52f6c12f-d013-4eb0-bc05-ea51885c8f52" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "cinder-quobyte-52f6c12f-d013-4eb0-bc05-ea51885c8f52" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62760f3-54c4-424a-b77f-cf460f3f2b20]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:30 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 Jul 28 14:30:30 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:31 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52" returned: 0 in 0.788s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:31 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52 Jul 28 14:30:31 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:31 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-52f6c12f-d013-4eb0-bc05-ea51885c8f52" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "cinder-quobyte-52f6c12f-d013-4eb0-bc05-ea51885c8f52" released by "delete_volume" :: held 1.293s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Created reservations ['a07a3f13-5195-4ca0-b4e5-334113302cf7', 'c0338d4c-3b5c-49c5-b89b-323a424d06ac', '1daa319c-3f92-4ee0-b38c-a4bf8556fa84', '5ecab801-c10f-4167-b17c-a89376463dd9'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:32 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:32 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:32 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.697s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Deleted volume successfully. Jul 28 14:30:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d130c4a3-57c7-4fca-aa4e-b8f512153689 tempest-ServerRescueNegativeTestJSON-999192864 None] Lock "cinder-52f6c12f-d013-4eb0-bc05-ea51885c8f52-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-42af63cc-0d23-4eb5-9c9c-c8c3920ead3a tempest-BackendsCapabilitiesAdminTestsJSON-1274944086 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87385) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 14:30:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41846417-dcb0-4397-95ea-1ba86a04bd52 tempest-BackendsCapabilitiesAdminTestsJSON-1274944086 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87385) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Flow 'volume_create_manager' (a545efbe-a96e-48b7-824c-fdcaafb5aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b257575b-d66c-451f-9f21-71d0e2d13de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b257575b-d66c-451f-9f21-71d0e2d13de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1481088459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5ebc7b-aea6-4b59-abcb-5950374c6dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728926321c2f4c4fae9fe7328648509f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:41Z,use_quota=True,user_id='40eeb0e2a4cc4549bd4d443f5d904b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57987b1b-b898-4352-8805-bbc1adf4fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57987b1b-b898-4352-8805-bbc1adf4fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebea179f-e6c3-4a13-9ac3-486e2d209a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebea179f-e6c3-4a13-9ac3-486e2d209a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5ebc7b-aea6-4b59-abcb-5950374c6dae', 'volume_name': 'volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519425d5-b26b-47d7-9665-6178cb3939bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519425d5-b26b-47d7-9665-6178cb3939bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b988a37-78fa-4441-88cd-f0a55e9c190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Volume 6e5ebc7b-aea6-4b59-abcb-5950374c6dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae', 'volume_size': 1} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1481088459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5ebc7b-aea6-4b59-abcb-5950374c6dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728926321c2f4c4fae9fe7328648509f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:41Z,use_quota=True,user_id='40eeb0e2a4cc4549bd4d443f5d904b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Creating volume 6e5ebc7b-aea6-4b59-abcb-5950374c6dae {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:30:40 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:30:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:40 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae 1073741824 Jul 28 14:30:40 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:41 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae 1073741824" returned: 0 in 0.801s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:41 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae Jul 28 14:30:41 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:41 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b988a37-78fa-4441-88cd-f0a55e9c190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3bd66f-cd97-496e-a269-e2567eb06266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Volume volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae (6e5ebc7b-aea6-4b59-abcb-5950374c6dae): created successfully Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3bd66f-cd97-496e-a269-e2567eb06266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Flow 'volume_create_manager' (a545efbe-a96e-48b7-824c-fdcaafb5aba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-74a74f12-f60c-49b6-9ea1-06a3e7e040bf tempest-VolumeQuotasNegativeTestJSON-897607806 None] Created volume successfully. Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Acquiring lock "cinder-6e5ebc7b-aea6-4b59-abcb-5950374c6dae-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "cinder-6e5ebc7b-aea6-4b59-abcb-5950374c6dae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Acquiring lock "cinder-quobyte-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "cinder-quobyte-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2fa80f-1859-49dc-a8fb-cafb25053942]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:44 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae Jul 28 14:30:44 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:45 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" returned: 0 in 0.816s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:45 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae Jul 28 14:30:45 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:45 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" returned: 0 in 0.472s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "cinder-quobyte-6e5ebc7b-aea6-4b59-abcb-5950374c6dae" released by "delete_volume" :: held 1.383s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Created reservations ['be48b926-6252-4277-86ec-30aca63df631', 'b0d40b4e-f71d-4dae-a7de-5ac21fc82bc4', 'd7b08681-0640-436e-88d2-ef67db623451', '62a54699-59b0-4edb-9459-7f1de33747ea'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:46 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:46 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:46 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.361s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Deleted volume successfully. Jul 28 14:30:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3c3e9e72-b706-4638-a94f-bb74c6445158 tempest-VolumeQuotasNegativeTestJSON-897607806 None] Lock "cinder-6e5ebc7b-aea6-4b59-abcb-5950374c6dae-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:49 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:49 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:49 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.387s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 8 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:30:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Flow 'volume_create_manager' (74e09f48-8b40-41eb-9fd6-92e7eb73da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3482bbcc-3377-460c-84ea-e9e734d2843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3482bbcc-3377-460c-84ea-e9e734d2843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1641291926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8056bf0a-1b04-49cf-8e20-7ab7d9fee946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def75973d9948b0be97f4bf92187909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:56Z,use_quota=True,user_id='692074e1abcf4a5791923925bf5ee9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0410bfd7-bf39-48c1-a51c-e7b83ceff94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0410bfd7-bf39-48c1-a51c-e7b83ceff94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a448fdf-3552-41ca-a0dd-baa23f83c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a448fdf-3552-41ca-a0dd-baa23f83c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8056bf0a-1b04-49cf-8e20-7ab7d9fee946', 'volume_name': 'volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd3576-917e-46c0-ab31-9e9f74f34b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd3576-917e-46c0-ab31-9e9f74f34b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3040e89f-0bae-45a6-9690-8c92cc8b5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:55 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Volume 8056bf0a-1b04-49cf-8e20-7ab7d9fee946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946', 'volume_size': 1} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1641291926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8056bf0a-1b04-49cf-8e20-7ab7d9fee946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5def75973d9948b0be97f4bf92187909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:56Z,use_quota=True,user_id='692074e1abcf4a5791923925bf5ee9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Creating volume 8056bf0a-1b04-49cf-8e20-7ab7d9fee946 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:30:55 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:30:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:55 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 1073741824 Jul 28 14:30:55 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:56 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 1073741824" returned: 0 in 0.494s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:56 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 Jul 28 14:30:56 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:56 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3040e89f-0bae-45a6-9690-8c92cc8b5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea87ec7-b6f7-4f33-9387-e8d22ed4617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Volume volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 (8056bf0a-1b04-49cf-8e20-7ab7d9fee946): created successfully Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea87ec7-b6f7-4f33-9387-e8d22ed4617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Flow 'volume_create_manager' (74e09f48-8b40-41eb-9fd6-92e7eb73da9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2d53ac63-e8d2-49f5-88c9-8dbd7ede2198 tempest-VolumesServicesTestJSON-1900853327 None] Created volume successfully. Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Acquiring lock "cinder-8056bf0a-1b04-49cf-8e20-7ab7d9fee946-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "cinder-8056bf0a-1b04-49cf-8e20-7ab7d9fee946-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Acquiring lock "cinder-quobyte-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "cinder-quobyte-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba1546d-840a-4828-a685-4326b0b245c6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:58 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 Jul 28 14:30:58 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:58 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" returned: 0 in 0.426s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:58 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946 Jul 28 14:30:58 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:58 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "cinder-quobyte-8056bf0a-1b04-49cf-8e20-7ab7d9fee946" released by "delete_volume" :: held 0.733s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Created reservations ['95e4852d-0bda-4754-8beb-67f963d0ca63', 'c5ea6d85-27de-4bfd-9361-c311bf4caa00', '25efcc28-aa6c-493b-8bdc-2a03c1cc1ad7', '4e9aa706-3b0d-4d1c-81d2-460870870b7e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:59 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:30:59 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Flow 'volume_create_manager' (db4a8782-5bf5-4bd2-9356-8844ce11104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1824103a-c966-49e8-988e-28f67cfcb2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1824103a-c966-49e8-988e-28f67cfcb2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156441557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c58d82-fb81-497a-b7d8-e39961708580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3108fa6a217477c9f89cb281fb25d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:59Z,use_quota=True,user_id='9be424dfa5e84213892c298ff80ea165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c06cdd6-22c2-43d1-8393-670e77de4c66),volume_type_id=6c06cdd6-22c2-43d1-8393-670e77de4c66)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a94802d-6fcb-413c-9d1f-ee84636f9692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a94802d-6fcb-413c-9d1f-ee84636f9692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f2073f-d500-4c1f-a414-a335276dffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f2073f-d500-4c1f-a414-a335276dffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c58d82-fb81-497a-b7d8-e39961708580', 'volume_name': 'volume-94c58d82-fb81-497a-b7d8-e39961708580', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c97f5ce-34ed-4bdd-8791-33118d214e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c97f5ce-34ed-4bdd-8791-33118d214e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288fe179-af05-472d-865b-6cc7f45e602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:30:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Volume 94c58d82-fb81-497a-b7d8-e39961708580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c58d82-fb81-497a-b7d8-e39961708580', 'volume_size': 1} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1156441557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c58d82-fb81-497a-b7d8-e39961708580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3108fa6a217477c9f89cb281fb25d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:30:59Z,use_quota=True,user_id='9be424dfa5e84213892c298ff80ea165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c06cdd6-22c2-43d1-8393-670e77de4c66),volume_type_id=6c06cdd6-22c2-43d1-8393-670e77de4c66)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Creating volume 94c58d82-fb81-497a-b7d8-e39961708580 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:30:59 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:30:59 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 1073741824 Jul 28 14:30:59 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:30:59 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:30:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Deleted volume successfully. Jul 28 14:30:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f038275b-42f9-4b3f-b6cd-c76c6a7aa81d tempest-VolumesServicesTestJSON-1900853327 None] Lock "cinder-8056bf0a-1b04-49cf-8e20-7ab7d9fee946-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:00 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 1073741824" returned: 0 in 0.633s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:00 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 Jul 28 14:31:00 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:00 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288fe179-af05-472d-865b-6cc7f45e602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c58d82-fb81-497a-b7d8-e39961708580', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a04291-6fc9-41a8-88ab-8993f452bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Volume volume-94c58d82-fb81-497a-b7d8-e39961708580 (94c58d82-fb81-497a-b7d8-e39961708580): created successfully Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a04291-6fc9-41a8-88ab-8993f452bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Flow 'volume_create_manager' (db4a8782-5bf5-4bd2-9356-8844ce11104b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:00 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a9e21bfc-75d7-4f73-b164-c643b0a46229 tempest-VolumeTypesAccessTest-1147930584 None] Created volume successfully. Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Acquiring lock "cinder-94c58d82-fb81-497a-b7d8-e39961708580-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "cinder-94c58d82-fb81-497a-b7d8-e39961708580-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Acquiring lock "cinder-quobyte-94c58d82-fb81-497a-b7d8-e39961708580" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "cinder-quobyte-94c58d82-fb81-497a-b7d8-e39961708580" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa2ff8e-ba2b-4d6e-a7db-a0066a00105c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:01 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 Jul 28 14:31:01 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:02 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580" returned: 0 in 0.507s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:02 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580 Jul 28 14:31:02 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:02 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94c58d82-fb81-497a-b7d8-e39961708580" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "cinder-quobyte-94c58d82-fb81-497a-b7d8-e39961708580" released by "delete_volume" :: held 0.880s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:02 devstack cinder-volume[87385]: WARNING cinder.quota [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2047911052 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2047911052, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:31:02 devstack cinder-volume[87385]: WARNING cinder.quota [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2047911052 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2047911052, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Created reservations ['19a442fb-b1e8-4bc1-9845-f5950eae00bd', 'b8f5bdd8-8e55-45f7-af44-ba38781a779d', 'e4196964-21c6-4e7a-bd82-863b641156be', '46ae6afd-6efe-474e-be39-f76263d39b5e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:02 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:02 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:02 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:02 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Deleted volume successfully. Jul 28 14:31:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7971f93b-c3c0-4bf0-a4fb-3d059bd920ed tempest-VolumeTypesAccessTest-1147930584 None] Lock "cinder-94c58d82-fb81-497a-b7d8-e39961708580-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Flow 'volume_create_manager' (7ce86d3c-4137-4b7b-ae6e-7dc6d75e2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc62483-5c98-4214-b1da-df177bd99195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc62483-5c98-4214-b1da-df177bd99195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-21557333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf3b8b220a04fba85a1907d8bb7ff69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:06Z,use_quota=True,user_id='9963a2480c9f4508b7f530ab46b51151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5000c4-7574-412c-af70-91926116ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5000c4-7574-412c-af70-91926116ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa862fc-4e15-452f-9d2f-88711dcda48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa862fc-4e15-452f-9d2f-88711dcda48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e', 'volume_name': 'volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1f67db-6b7b-44c0-8a31-0c2c4fb5c65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1f67db-6b7b-44c0-8a31-0c2c4fb5c65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237564bc-9844-4f99-98cc-46997639b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Volume 21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e', 'volume_size': 1} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-21557333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf3b8b220a04fba85a1907d8bb7ff69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:06Z,use_quota=True,user_id='9963a2480c9f4508b7f530ab46b51151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Creating volume 21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:06 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:06 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e 1073741824 Jul 28 14:31:06 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:06 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e 1073741824" returned: 0 in 0.598s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:06 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e Jul 28 14:31:06 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:07 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" returned: 0 in 0.340s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237564bc-9844-4f99-98cc-46997639b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97ed845-9831-4f7a-8d88-88f3e60b64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Volume volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e (21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e): created successfully Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97ed845-9831-4f7a-8d88-88f3e60b64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Flow 'volume_create_manager' (7ce86d3c-4137-4b7b-ae6e-7dc6d75e2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0dd3599d-3e9b-47c5-aed0-2e38a277c2a7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Created volume successfully. Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Flow 'volume_create_manager' (fad34582-36bd-44c7-845a-6da84f0ad373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b783f54b-6aa0-4b47-8566-b4c4118bbf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b783f54b-6aa0-4b47-8566-b4c4118bbf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-469659219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ab7d8b-4669-4e07-b85d-1f5860ed77f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8f0d0dbbd4b19964884ecf245ebf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:07Z,use_quota=True,user_id='421284281dab49c7ab19e934a72a1c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9f73b6-5ba6-4315-b608-0f54ab9bb376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9f73b6-5ba6-4315-b608-0f54ab9bb376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe5cd45-3ad9-48e7-83b7-0a0871392fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe5cd45-3ad9-48e7-83b7-0a0871392fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ab7d8b-4669-4e07-b85d-1f5860ed77f7', 'volume_name': 'volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddab2b2-bba4-4da7-a130-891f010e9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddab2b2-bba4-4da7-a130-891f010e9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e10909-a5f5-4668-8dbc-1576016b27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Volume 81ab7d8b-4669-4e07-b85d-1f5860ed77f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7', 'volume_size': 1} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-469659219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ab7d8b-4669-4e07-b85d-1f5860ed77f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8f0d0dbbd4b19964884ecf245ebf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:07Z,use_quota=True,user_id='421284281dab49c7ab19e934a72a1c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Creating volume 81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:07 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 1073741824 Jul 28 14:31:07 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:08 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 1073741824" returned: 0 in 0.558s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:08 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 Jul 28 14:31:08 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:08 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e10909-a5f5-4668-8dbc-1576016b27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c8b93f-09ab-4ea4-8899-44696b407e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:08 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Volume volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 (81ab7d8b-4669-4e07-b85d-1f5860ed77f7): created successfully Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c8b93f-09ab-4ea4-8899-44696b407e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Flow 'volume_create_manager' (fad34582-36bd-44c7-845a-6da84f0ad373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-061dc502-87d8-432a-a9e6-18a03a6a38e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Created volume successfully. Jul 28 14:31:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Creating offline snapshot ff6cc2d0-7abc-40da-935c-cb76fd9d465f of volume 81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:31:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e17e38-9d72-4484-912d-962b4c8e6bf2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:10 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 Jul 28 14:31:10 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:10 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" returned: 0 in 0.491s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:10 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f 1G Jul 28 14:31:10 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:10 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f 1G" returned: 0 in 0.495s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:10 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f Jul 28 14:31:10 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:11 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:11 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f is being set with open permissions: ugo+rw Jul 28 14:31:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:11 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f Jul 28 14:31:11 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:11 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:11 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info Jul 28 14:31:11 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:12 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info" returned: 0 in 0.308s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:12 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info is being set with open permissions: ugo+rw Jul 28 14:31:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:12 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info Jul 28 14:31:12 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:12 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.info" returned: 0 in 0.386s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-100fd67a-313f-410c-a7db-84fc33ad0793 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Create snapshot completed successfully Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "cinder-ff6cc2d0-7abc-40da-935c-cb76fd9d465f-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-ff6cc2d0-7abc-40da-935c-cb76fd9d465f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "cinder-quobyte-ff6cc2d0-7abc-40da-935c-cb76fd9d465f" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-ff6cc2d0-7abc-40da-935c-cb76fd9d465f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Deleting offline snapshot ff6cc2d0-7abc-40da-935c-cb76fd9d465f of volume 81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] snapshot_file for this snap is: volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0fa9fa-7c69-4cf0-9547-07121bdd7785]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:14 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f Jul 28 14:31:14 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:15 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f" returned: 0 in 0.747s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce135d-9d25-4261-9cbe-f388d3a7c67f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:15 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 Jul 28 14:31:15 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:15 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" returned: 0 in 0.433s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:15 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f Jul 28 14:31:15 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:16 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f" returned: 0 in 0.541s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:16 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f Jul 28 14:31:16 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:16 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7.ff6cc2d0-7abc-40da-935c-cb76fd9d465f" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-ff6cc2d0-7abc-40da-935c-cb76fd9d465f" released by "_delete_snapshot" :: held 2.206s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" released by "delete_snapshot" :: held 2.236s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:16 devstack cinder-volume[87385]: WARNING cinder.quota [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Created reservations ['a15a4891-1009-481f-a9f4-f2c514be9a75', '1a4b415a-0297-4f0a-a98a-9f1d2bbbc9bb', 'b0a0efe2-d2bf-4eec-b127-9d837da23f5e', '5d03bfa5-15d1-4163-9d36-6bf99e49e2b8'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Delete snapshot completed successfully. Jul 28 14:31:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-30f4646f-c7ea-459a-9263-c34430f2cf56 tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-ff6cc2d0-7abc-40da-935c-cb76fd9d465f-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "cinder-81ab7d8b-4669-4e07-b85d-1f5860ed77f7-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-81ab7d8b-4669-4e07-b85d-1f5860ed77f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f780e811-b342-44c8-a0c3-b947954112d5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:18 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 Jul 28 14:31:18 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:18 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" returned: 0 in 0.704s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:18 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7 Jul 28 14:31:18 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:19 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" returned: 0 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-quobyte-81ab7d8b-4669-4e07-b85d-1f5860ed77f7" released by "delete_volume" :: held 1.210s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Flow 'volume_create_manager' (cd9c2f4e-39bd-4940-ae53-fe1bc43c63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d8174-7f9d-435e-a9b7-d5e5822a28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Created reservations ['f3b403d7-b42d-42b8-9f59-05998abdb2c1', '838e7a96-5292-42f2-8992-88bc053baf55', '70d2dc5e-e9b7-4459-b534-3da9b82221ef', '67c10641-1ab7-4fd8-bd62-a9799a5384e9'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d8174-7f9d-435e-a9b7-d5e5822a28e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843876003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18231e2-2d80-4c92-a9ad-d7f3c1046512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67709f43107044e6993d7517acb5313d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:19Z,use_quota=True,user_id='0c7c360631c04667aa79bd46cbfac03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b7a45a-4705-4b01-b668-a6c4901fe4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b7a45a-4705-4b01-b668-a6c4901fe4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f8bec7-3ffb-4259-89ab-74ceb8ab1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:19 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:19 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:20 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.497s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Deleted volume successfully. Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=85,cinder:SELECT=47,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-68364b35-a918-4377-bf53-b126e002d3ac tempest-VolumeSnapshotQuotasNegativeTestJSON-522095215 None] Lock "cinder-81ab7d8b-4669-4e07-b85d-1f5860ed77f7-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f8bec7-3ffb-4259-89ab-74ceb8ab1109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b18231e2-2d80-4c92-a9ad-d7f3c1046512', 'volume_name': 'volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37c33c-c4f7-4d70-af7f-cdc56bc77382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37c33c-c4f7-4d70-af7f-cdc56bc77382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a4f3b3-cf2f-44cf-8a84-38463dd080ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Volume b18231e2-2d80-4c92-a9ad-d7f3c1046512: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 14:31:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Trying to clone b18231e2-2d80-4c92-a9ad-d7f3c1046512 from image b313c492-604e-4cdd-96f9-0cabb9f2068f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:31:21 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:31:21 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Image download 20.69 MB at 20.53 MB/s Jul 28 14:31:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9698f0c9-35fc-4f0c-bbe5-6b13ceb06137]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:21 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD Jul 28 14:31:21 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:22 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD" returned: 0 in 0.615s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f is fetched for user 0c7c360631c04667aa79bd46cbfac03b. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=58,cinder:UPDATE=62,cinder:DELETE=8,cinder:INSERT=17 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb200189-ec1f-4f75-8d7a-eb2737f57d0f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:22 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD Jul 28 14:31:22 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:22 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843876003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18231e2-2d80-4c92-a9ad-d7f3c1046512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67709f43107044e6993d7517acb5313d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:19Z,use_quota=True,user_id='0c7c360631c04667aa79bd46cbfac03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Creating volume b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:22 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:22 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1073741824 Jul 28 14:31:22 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-5fe953a3-6192-4f85-b31d-863376f3a670 req-ea1cb38f-fcd0-44ae-b6b8-315639f6c628 tempest-AttachVolumeShelveTestJSON-1282332757 None] No connector for attachment 99a7ef03-839c-4c1d-9c30-12771d5f1678; skipping storage backend terminate_connection call. {{(pid=87385) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 28 14:31:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-5fe953a3-6192-4f85-b31d-863376f3a670 req-ea1cb38f-fcd0-44ae-b6b8-315639f6c628 tempest-AttachVolumeShelveTestJSON-1282332757 None] Deleting attachment 99a7ef03-839c-4c1d-9c30-12771d5f1678. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:31:23 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1073741824" returned: 0 in 0.812s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:23 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 Jul 28 14:31:23 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:23 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:24 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Attempting download of b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume b18231e2-2d80-4c92-a9ad-d7f3c1046512. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:31:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2927b72-8c14-4275-8075-86b4e72fb394]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:24 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz Jul 28 14:31:24 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:24 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz" returned: 0 in 0.551s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:24 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz Jul 28 14:31:24 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:25 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz" returned: 1 in 0.624s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_neee80iz' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ade35a-9ff8-4975-91d2-d55e85bb6035]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:25 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD Jul 28 14:31:25 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:25 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] b313c492-604e-4cdd-96f9-0cabb9f2068f was qcow2, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:31:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:25 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 Jul 28 14:31:25 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:28 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512" returned: 0 in 2.527s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_xmqsoiokdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:31:28 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Converted 112.00 MB image at 44.29 MB/s Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:28 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1G Jul 28 14:31:28 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:28 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 1G" returned: 0 in 0.516s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Downloaded image b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume b18231e2-2d80-4c92-a9ad-d7f3c1046512 successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f for user 0c7c360631c04667aa79bd46cbfac03b is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Marking volume b18231e2-2d80-4c92-a9ad-d7f3c1046512 as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Copying metadata from image b313c492-604e-4cdd-96f9-0cabb9f2068f to b18231e2-2d80-4c92-a9ad-d7f3c1046512. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:31:28 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Creating volume glance metadata for volume b18231e2-2d80-4c92-a9ad-d7f3c1046512 backed by image b313c492-604e-4cdd-96f9-0cabb9f2068f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:31:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a4f3b3-cf2f-44cf-8a84-38463dd080ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf3456-9de8-4682-9cc3-df3825bfff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Volume volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 (b18231e2-2d80-4c92-a9ad-d7f3c1046512): created successfully Jul 28 14:31:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf3456-9de8-4682-9cc3-df3825bfff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Flow 'volume_create_manager' (cd9c2f4e-39bd-4940-ae53-fe1bc43c63fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c0583ecf-34df-429a-812f-7a8c9db9ec4a tempest-VolumesImageMetadata-1159761157 None] Created volume successfully. Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Acquiring lock "cinder-b18231e2-2d80-4c92-a9ad-d7f3c1046512-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "cinder-b18231e2-2d80-4c92-a9ad-d7f3c1046512-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Acquiring lock "cinder-quobyte-b18231e2-2d80-4c92-a9ad-d7f3c1046512" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "cinder-quobyte-b18231e2-2d80-4c92-a9ad-d7f3c1046512" acquired by "delete_volume" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9181aa-6bd7-4df2-bd7c-13e5921b5e1c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:30 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 Jul 28 14:31:30 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:30 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512" returned: 0 in 0.585s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:30 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512 Jul 28 14:31:30 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:31 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b18231e2-2d80-4c92-a9ad-d7f3c1046512" returned: 0 in 0.335s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "cinder-quobyte-b18231e2-2d80-4c92-a9ad-d7f3c1046512" released by "delete_volume" :: held 0.999s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Created reservations ['9f1f30d8-6b89-4ca6-a902-991ee6ee63f4', 'ff03963c-ce48-4888-af4b-928fc05fd026', '5d7db3cd-6246-4e49-a2b6-1b3394a098aa', '2fecc08f-57e1-4b1b-8c92-7f20ec69b18c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:31 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:31 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:31 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.335s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Deleted volume successfully. Jul 28 14:31:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db8b60dc-bf07-4be1-85e1-b7c1797d3f27 tempest-VolumesImageMetadata-1159761157 None] Lock "cinder-b18231e2-2d80-4c92-a9ad-d7f3c1046512-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Flow 'volume_create_manager' (dc6ee3e2-7195-4b3d-8834-e011cdfa74fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23fb6a7-7307-4a3e-aee3-692c13016e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Flow 'volume_create_manager' (ed0ed183-ae03-42d4-96ea-4d29563cc6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163d52f1-7e2f-44d9-8162-5ef81aa6d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23fb6a7-7307-4a3e-aee3-692c13016e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1712392683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e3248b-2ee1-441f-bbf7-b5617acf66eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368ec8caeca4525b85fb56bc9007dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:39Z,use_quota=True,user_id='693e9217dd6b468c99a153ac11eb7246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41e8137-15c6-43e0-9778-98fc51ea4cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41e8137-15c6-43e0-9778-98fc51ea4cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3c473-87a2-4d21-a0d5-28045feadddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3c473-87a2-4d21-a0d5-28045feadddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e3248b-2ee1-441f-bbf7-b5617acf66eb', 'volume_name': 'volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68035a29-e180-4922-8376-cd8bf854c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68035a29-e180-4922-8376-cd8bf854c68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4bc224-5164-4eb9-bc10-40a5f796dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Volume 56e3248b-2ee1-441f-bbf7-b5617acf66eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb', 'volume_size': 1} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1712392683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e3248b-2ee1-441f-bbf7-b5617acf66eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368ec8caeca4525b85fb56bc9007dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:39Z,use_quota=True,user_id='693e9217dd6b468c99a153ac11eb7246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Creating volume 56e3248b-2ee1-441f-bbf7-b5617acf66eb {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:39 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:39 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb 1073741824 Jul 28 14:31:39 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163d52f1-7e2f-44d9-8162-5ef81aa6d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-871444598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0f14cf-2218-457f-ba8c-4a0c2c176a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517ac38ead6f4120a679fac22712906b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:39Z,use_quota=True,user_id='59d13678e08840e5bab13c3ebf09de10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d2b53f-79ff-4bcf-9991-4cd0bb4d8983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d2b53f-79ff-4bcf-9991-4cd0bb4d8983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a07bed-7260-4dd5-8fa1-e91c44fd35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a07bed-7260-4dd5-8fa1-e91c44fd35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0f14cf-2218-457f-ba8c-4a0c2c176a0d', 'volume_name': 'volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca5a72-ae30-4b4b-9148-9650f0baa7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca5a72-ae30-4b4b-9148-9650f0baa7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a077ad8-2719-47d2-a349-e98494faa103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:39 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Volume 8b0f14cf-2218-457f-ba8c-4a0c2c176a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d', 'volume_size': 1} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:39 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb 1073741824" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:39 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb Jul 28 14:31:39 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:40 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-871444598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0f14cf-2218-457f-ba8c-4a0c2c176a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517ac38ead6f4120a679fac22712906b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:39Z,use_quota=True,user_id='59d13678e08840e5bab13c3ebf09de10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Creating volume 8b0f14cf-2218-457f-ba8c-4a0c2c176a0d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:40 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4bc224-5164-4eb9-bc10-40a5f796dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0642c3-5571-4538-b62c-12e50437c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:40 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d 1073741824 Jul 28 14:31:40 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Volume volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb (56e3248b-2ee1-441f-bbf7-b5617acf66eb): created successfully Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0642c3-5571-4538-b62c-12e50437c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Flow 'volume_create_manager' (dc6ee3e2-7195-4b3d-8834-e011cdfa74fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2a768d93-4e83-48fc-86ec-6a842e48fd33 tempest-VolumesTransfersTest-1641706059 None] Created volume successfully. Jul 28 14:31:40 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d 1073741824" returned: 0 in 0.470s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:40 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d Jul 28 14:31:40 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:40 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a077ad8-2719-47d2-a349-e98494faa103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6cc76b-53fb-4935-8a58-9265b2ac07f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Volume volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d (8b0f14cf-2218-457f-ba8c-4a0c2c176a0d): created successfully Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6cc76b-53fb-4935-8a58-9265b2ac07f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Flow 'volume_create_manager' (ed0ed183-ae03-42d4-96ea-4d29563cc6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3597e0b5-5945-4714-8930-1a853ee5a35c tempest-VolumesNegativeTest-517664749 None] Created volume successfully. Jul 28 14:31:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-736a071d-e2e3-4e8b-b4fc-92849c61adba tempest-VolumesTransfersTest-1081279031 None] Transfer volume completed successfully. Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "cinder-56e3248b-2ee1-441f-bbf7-b5617acf66eb-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-56e3248b-2ee1-441f-bbf7-b5617acf66eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "cinder-quobyte-56e3248b-2ee1-441f-bbf7-b5617acf66eb" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-quobyte-56e3248b-2ee1-441f-bbf7-b5617acf66eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f516fa1-5f43-434a-81db-352bb6613f70]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:42 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb Jul 28 14:31:42 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:42 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb" returned: 0 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:42 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb Jul 28 14:31:42 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:42 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-56e3248b-2ee1-441f-bbf7-b5617acf66eb" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-quobyte-56e3248b-2ee1-441f-bbf7-b5617acf66eb" released by "delete_volume" :: held 0.767s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Created reservations ['b0fe1faf-872f-484c-825c-be147d916567', '252fdb5e-5464-4151-8709-039520baf921', 'b9c9c1db-99d0-477a-a90a-147d774cc80e', '444e0055-487f-4a17-92e0-3a1e74d5415d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:43 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:43 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:43 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.344s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Deleted volume successfully. Jul 28 14:31:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-aae09c66-a566-4e72-9302-3bbf62203689 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-56e3248b-2ee1-441f-bbf7-b5617acf66eb-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Flow 'volume_create_manager' (d2287691-8aa6-4b29-872e-282dfb7b99cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae83fd21-21e0-4245-a22a-079a8ad7bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae83fd21-21e0-4245-a22a-079a8ad7bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-799934152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28191e1-5d85-4ba7-8a24-9d3ca612009f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368ec8caeca4525b85fb56bc9007dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:44Z,use_quota=True,user_id='693e9217dd6b468c99a153ac11eb7246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5895447c-1119-4dd4-a93b-62bc2b48faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5895447c-1119-4dd4-a93b-62bc2b48faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb3b165-af4c-4388-b695-6592804d4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb3b165-af4c-4388-b695-6592804d4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28191e1-5d85-4ba7-8a24-9d3ca612009f', 'volume_name': 'volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febcc044-df7e-4b50-ae7a-d87b7efe7f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febcc044-df7e-4b50-ae7a-d87b7efe7f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9be5a8-740c-4546-a65e-7caa3c6c881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:44 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Volume d28191e1-5d85-4ba7-8a24-9d3ca612009f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f', 'volume_size': 1} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-799934152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28191e1-5d85-4ba7-8a24-9d3ca612009f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368ec8caeca4525b85fb56bc9007dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:44Z,use_quota=True,user_id='693e9217dd6b468c99a153ac11eb7246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Creating volume d28191e1-5d85-4ba7-8a24-9d3ca612009f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:44 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:44 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f 1073741824 Jul 28 14:31:44 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:44 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f 1073741824" returned: 0 in 0.619s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:44 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f Jul 28 14:31:44 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:45 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9be5a8-740c-4546-a65e-7caa3c6c881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecaeb4b-335f-462e-93e2-144e5958618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Volume volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f (d28191e1-5d85-4ba7-8a24-9d3ca612009f): created successfully Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecaeb4b-335f-462e-93e2-144e5958618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Flow 'volume_create_manager' (d2287691-8aa6-4b29-872e-282dfb7b99cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-34176ac8-ebb7-49b3-bfd2-7d396304b6d4 tempest-VolumesTransfersTest-1641706059 None] Created volume successfully. Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (de0be28c-c7c4-45e2-a873-b5e888f48dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6a644-8664-43ca-bf77-2ab21a73ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b6a644-8664-43ca-bf77-2ab21a73ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-899065727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a148600e-9fff-4766-ba4e-0bf0efe10409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:46Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75f25e-cb64-48aa-ba4d-3e1c4e488d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75f25e-cb64-48aa-ba4d-3e1c4e488d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204787cd-1ae3-4050-aa2a-a4d1c9fe436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204787cd-1ae3-4050-aa2a-a4d1c9fe436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a148600e-9fff-4766-ba4e-0bf0efe10409', 'volume_name': 'volume-a148600e-9fff-4766-ba4e-0bf0efe10409', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9922d113-b4a7-4fae-8cd6-47c55114e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9922d113-b4a7-4fae-8cd6-47c55114e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c46bd86-829a-41c2-8fff-d714cb25d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Volume a148600e-9fff-4766-ba4e-0bf0efe10409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a148600e-9fff-4766-ba4e-0bf0efe10409', 'volume_size': 1} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-899065727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a148600e-9fff-4766-ba4e-0bf0efe10409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:31:46Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Creating volume a148600e-9fff-4766-ba4e-0bf0efe10409 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:31:46 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:46 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 1073741824 Jul 28 14:31:46 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "cinder-d28191e1-5d85-4ba7-8a24-9d3ca612009f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-d28191e1-5d85-4ba7-8a24-9d3ca612009f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "cinder-quobyte-d28191e1-5d85-4ba7-8a24-9d3ca612009f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-quobyte-d28191e1-5d85-4ba7-8a24-9d3ca612009f" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d52787e-ec5d-44b7-b527-f7003df780ec]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:31:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:47 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f Jul 28 14:31:47 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:47 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 1073741824" returned: 0 in 0.910s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:47 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 Jul 28 14:31:47 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:47 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f" returned: 0 in 0.564s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:47 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f Jul 28 14:31:47 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:47 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409" returned: 0 in 0.536s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c46bd86-829a-41c2-8fff-d714cb25d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a148600e-9fff-4766-ba4e-0bf0efe10409', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff561aa-46db-4457-a311-3cccea573eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:31:47 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Volume volume-a148600e-9fff-4766-ba4e-0bf0efe10409 (a148600e-9fff-4766-ba4e-0bf0efe10409): created successfully Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff561aa-46db-4457-a311-3cccea573eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (de0be28c-c7c4-45e2-a873-b5e888f48dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:31:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4c108b7e-0770-4c46-aab4-03571d6710c8 tempest-AttachVolumeTestJSON-668992739 None] Created volume successfully. Jul 28 14:31:47 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d28191e1-5d85-4ba7-8a24-9d3ca612009f" returned: 0 in 0.440s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-quobyte-d28191e1-5d85-4ba7-8a24-9d3ca612009f" released by "delete_volume" :: held 1.081s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Created reservations ['a0f4c50b-e82c-4258-b723-c6e02c4790c3', '01622033-1b29-4695-b866-ff021a9a46b1', 'ac999a29-e60c-404e-826e-5b3d85615661', '632936ad-5eb2-4101-a7d4-87b149b0062b'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:48 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:48 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:48 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.355s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Deleted volume successfully. Jul 28 14:31:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3b207ccf-e314-42f9-b93e-51e88a480031 tempest-VolumesTransfersTest-918927688 None] Lock "cinder-d28191e1-5d85-4ba7-8a24-9d3ca612009f-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.084s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:31:49 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:31:49 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-455711f9-0765-4df6-920a-1b703630bb33 req-f2d666e0-89a2-4378-88a4-2ec09ce0d137 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-455711f9-0765-4df6-920a-1b703630bb33 req-f2d666e0-89a2-4378-88a4-2ec09ce0d137 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-455711f9-0765-4df6-920a-1b703630bb33 req-f2d666e0-89a2-4378-88a4-2ec09ce0d137 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:31:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-455711f9-0765-4df6-920a-1b703630bb33 req-f2d666e0-89a2-4378-88a4-2ec09ce0d137 tempest-AttachVolumeTestJSON-668992739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-a148600e-9fff-4766-ba4e-0bf0efe10409', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4262b9e2-89e7-43b3-87bf-2a9695380e6f', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:31:50 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-455711f9-0765-4df6-920a-1b703630bb33 req-f2d666e0-89a2-4378-88a4-2ec09ce0d137 tempest-AttachVolumeTestJSON-668992739 None] attachment_update completed successfully. Jul 28 14:31:50 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 28 14:31:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 1.115s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:31:50 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:31:50 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:31:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 28 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:31:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:31:59 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=39,cinder:INSERT=14,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=40,cinder:UPDATE=40,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Flow 'volume_create_manager' (9f6a5560-1052-4a3f-b60a-16e61a3bb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f2b59-d51c-4e0b-88d0-849e692b6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f2b59-d51c-4e0b-88d0-849e692b6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-814336246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58194f7e-c978-4dec-a8bb-f8840af367cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d94257c42874ab9bb894decd040b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:00Z,use_quota=True,user_id='77342ea37ee54f0d8b910b005fa5af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8a81b-6a7a-492b-93d9-374824a43a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf8a81b-6a7a-492b-93d9-374824a43a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be884d4f-ab1f-437c-8dad-655265601d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be884d4f-ab1f-437c-8dad-655265601d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58194f7e-c978-4dec-a8bb-f8840af367cf', 'volume_name': 'volume-58194f7e-c978-4dec-a8bb-f8840af367cf', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9b86bc-eb7d-4d29-ab73-34b7b1caf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9b86bc-eb7d-4d29-ab73-34b7b1caf75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd74716a-4884-4b67-a2d2-1fc38f22a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Volume 58194f7e-c978-4dec-a8bb-f8840af367cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58194f7e-c978-4dec-a8bb-f8840af367cf', 'volume_size': 1} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-814336246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58194f7e-c978-4dec-a8bb-f8840af367cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d94257c42874ab9bb894decd040b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:00Z,use_quota=True,user_id='77342ea37ee54f0d8b910b005fa5af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Creating volume 58194f7e-c978-4dec-a8bb-f8840af367cf {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:00 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:00 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf 1073741824 Jul 28 14:32:00 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:01 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf 1073741824" returned: 0 in 0.524s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:01 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf Jul 28 14:32:01 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:01 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf" returned: 0 in 0.405s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd74716a-4884-4b67-a2d2-1fc38f22a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58194f7e-c978-4dec-a8bb-f8840af367cf', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24fedef-805f-43cf-ba07-33d04c1efbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:01 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Volume volume-58194f7e-c978-4dec-a8bb-f8840af367cf (58194f7e-c978-4dec-a8bb-f8840af367cf): created successfully Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24fedef-805f-43cf-ba07-33d04c1efbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Flow 'volume_create_manager' (9f6a5560-1052-4a3f-b60a-16e61a3bb637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-16350097-f464-4c28-b866-993a69fdabc3 tempest-VolumesTransfersV355Test-2059431290 None] Created volume successfully. Jul 28 14:32:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4ddfbe8f-3c8c-4d41-9a8d-ef3b32bafe49 tempest-VolumesTransfersV355Test-1562962832 None] Transfer volume completed successfully. Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "cinder-58194f7e-c978-4dec-a8bb-f8840af367cf-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-58194f7e-c978-4dec-a8bb-f8840af367cf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "cinder-quobyte-58194f7e-c978-4dec-a8bb-f8840af367cf" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-quobyte-58194f7e-c978-4dec-a8bb-f8840af367cf" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbb04a0-1e31-4927-8232-76f6631c616b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:04 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf Jul 28 14:32:04 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:05 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf" returned: 0 in 0.622s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:05 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf Jul 28 14:32:05 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:05 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-58194f7e-c978-4dec-a8bb-f8840af367cf" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-quobyte-58194f7e-c978-4dec-a8bb-f8840af367cf" released by "delete_volume" :: held 1.010s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Created reservations ['dbbcfca4-4916-470b-a1d4-037ec5d8d386', 'f4bc180f-b618-4451-98e0-82f090a47c1f', '3165582c-febd-459e-b3d6-0e09b765b55b', 'c821da7f-a910-4480-9ca8-4d3dd921e84a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Acquiring lock "cinder-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "cinder-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Acquiring lock "cinder-quobyte-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "cinder-quobyte-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" acquired by "delete_volume" :: waited 0.036s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:05 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:05 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38da5b-98a7-4026-86d8-05aee003c371]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:05 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d Jul 28 14:32:05 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:06 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Deleted volume successfully. Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b9234646-bcb8-4332-ab31-c0195ba45ade tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-58194f7e-c978-4dec-a8bb-f8840af367cf-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:06 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:06 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d Jul 28 14:32:06 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:06 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" returned: 0 in 0.276s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "cinder-quobyte-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d" released by "delete_volume" :: held 0.736s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Created reservations ['823dc1f2-58d0-4759-b52f-ebd6b1767699', '8158ec44-022d-4efa-a196-613be7bdada6', 'a544aa2e-2bcc-4eb0-ad8c-fd081d278ecc', '15955014-33fb-46ac-9abd-9bd27c45f5b1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:06 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:06 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:07 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.393s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Deleted volume successfully. Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6e66d03f-2d2e-4312-9f53-27592e129cf9 tempest-VolumesNegativeTest-517664749 None] Lock "cinder-8b0f14cf-2218-457f-ba8c-4a0c2c176a0d-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Acquiring lock "cinder-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "cinder-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Flow 'volume_create_manager' (1ee1a1b5-1cf0-42cb-9abe-3dcb4f596b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a339dc-fb93-4e3b-905b-4e80a533220f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a339dc-fb93-4e3b-905b-4e80a533220f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2009500102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38b07bf-e12c-4f63-aa16-bb834be92e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d94257c42874ab9bb894decd040b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:08Z,use_quota=True,user_id='77342ea37ee54f0d8b910b005fa5af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06da6208-aeeb-4d61-8993-897b0f9c6626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06da6208-aeeb-4d61-8993-897b0f9c6626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4914a1-9cb6-4718-a887-fd263549b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4914a1-9cb6-4718-a887-fd263549b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38b07bf-e12c-4f63-aa16-bb834be92e59', 'volume_name': 'volume-e38b07bf-e12c-4f63-aa16-bb834be92e59', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2f6d74-66dc-4760-8514-67a4449d54c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2f6d74-66dc-4760-8514-67a4449d54c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1dd1ca-eb45-429a-a51e-4a62d3571506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Volume e38b07bf-e12c-4f63-aa16-bb834be92e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38b07bf-e12c-4f63-aa16-bb834be92e59', 'volume_size': 1} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2009500102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38b07bf-e12c-4f63-aa16-bb834be92e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d94257c42874ab9bb894decd040b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:08Z,use_quota=True,user_id='77342ea37ee54f0d8b910b005fa5af4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Creating volume e38b07bf-e12c-4f63-aa16-bb834be92e59 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Acquiring lock "cinder-quobyte-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:07 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 1073741824 Jul 28 14:32:07 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "cinder-quobyte-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ac7e90-20e9-45b3-babc-f065f317f25b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:08 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e Jul 28 14:32:08 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:08 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" returned: 0 in 0.471s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:08 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 1073741824" returned: 0 in 0.584s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:08 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e Jul 28 14:32:08 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:08 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 Jul 28 14:32:08 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:08 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" returned: 0 in 0.385s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "cinder-quobyte-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e" released by "delete_volume" :: held 0.917s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:08 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1dd1ca-eb45-429a-a51e-4a62d3571506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38b07bf-e12c-4f63-aa16-bb834be92e59', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e322324-4013-4357-9800-0dceaf149479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:08 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Volume volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 (e38b07bf-e12c-4f63-aa16-bb834be92e59): created successfully Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e322324-4013-4357-9800-0dceaf149479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Flow 'volume_create_manager' (1ee1a1b5-1cf0-42cb-9abe-3dcb4f596b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Created reservations ['50c57b5b-c25b-4585-af49-16759cf9856a', '7d619ef2-88f1-4595-9b11-2039ed2fefd1', 'f9288be1-5daa-4a21-aa2b-2d7420c4c403', 'a74545d3-eb13-45a7-b773-9ddf0903ff5c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c21557f8-c428-4399-aade-0dac61f3c800 tempest-VolumesTransfersV355Test-2059431290 None] Created volume successfully. Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:09 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:09 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:09 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.319s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Deleted volume successfully. Jul 28 14:32:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-444dfff2-0510-421c-b8a9-efab76982cb7 tempest-AttachVolumeShelveTestJSON-1282332757 None] Lock "cinder-21be5d59-35ad-4d5c-bc39-d1bf7a91bf6e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "cinder-e38b07bf-e12c-4f63-aa16-bb834be92e59-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-e38b07bf-e12c-4f63-aa16-bb834be92e59-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "cinder-quobyte-e38b07bf-e12c-4f63-aa16-bb834be92e59" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-quobyte-e38b07bf-e12c-4f63-aa16-bb834be92e59" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f29390-a1a3-487e-9188-6db65cba53f6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Flow 'volume_create_manager' (2bf5a6a9-7c07-4f88-975f-6a29c1b541ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2ded43-6298-4141-a16d-3015b6406bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2ded43-6298-4141-a16d-3015b6406bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1658133829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb05b161-0c6a-4949-84c9-b03a1926311a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646902cabd0e496b9f77834057e16e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:10Z,use_quota=True,user_id='0f96bf5b70394aa483b1809b64e8ba08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e377de-ea6d-490e-8ac7-d533b4a7fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e377de-ea6d-490e-8ac7-d533b4a7fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c5896-5e67-498f-9132-12d5921f9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416c5896-5e67-498f-9132-12d5921f9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb05b161-0c6a-4949-84c9-b03a1926311a', 'volume_name': 'volume-cb05b161-0c6a-4949-84c9-b03a1926311a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:10 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 Jul 28 14:32:10 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ebbf2d-614e-49c9-ac0b-1b95170d91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ebbf2d-614e-49c9-ac0b-1b95170d91e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fabb73-109f-4e12-81ec-d8e4544d7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Volume cb05b161-0c6a-4949-84c9-b03a1926311a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb05b161-0c6a-4949-84c9-b03a1926311a', 'volume_size': 1} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1658133829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb05b161-0c6a-4949-84c9-b03a1926311a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646902cabd0e496b9f77834057e16e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:10Z,use_quota=True,user_id='0f96bf5b70394aa483b1809b64e8ba08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Creating volume cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:10 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:10 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a 1073741824 Jul 28 14:32:10 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:11 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59" returned: 0 in 0.693s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:11 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59 Jul 28 14:32:11 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:11 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a 1073741824" returned: 0 in 0.822s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:11 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e38b07bf-e12c-4f63-aa16-bb834be92e59" returned: 0 in 0.465s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:11 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:11 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-quobyte-e38b07bf-e12c-4f63-aa16-bb834be92e59" released by "delete_volume" :: held 1.250s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Created reservations ['16efd167-8a80-4d80-a00e-9da6e9b78fcf', 'b7c426e1-6826-437c-b718-4d36eb3b1fda', '7fa1dd7f-2bb3-42cf-91ce-cef6513915c9', '56ea3f6c-36a0-4705-9649-c10dd44565f6'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:12 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:12 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:12 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fabb73-109f-4e12-81ec-d8e4544d7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb05b161-0c6a-4949-84c9-b03a1926311a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af43afa4-b516-4920-8560-7c99986319b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Volume volume-cb05b161-0c6a-4949-84c9-b03a1926311a (cb05b161-0c6a-4949-84c9-b03a1926311a): created successfully Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af43afa4-b516-4920-8560-7c99986319b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Flow 'volume_create_manager' (2bf5a6a9-7c07-4f88-975f-6a29c1b541ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-66beaf37-72c8-4eb7-94b6-2ecb04e75deb tempest-VolumeDependencyTests-1958317390 None] Created volume successfully. Jul 28 14:32:12 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Deleted volume successfully. Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b2dc80-9afd-4c43-a3be-03b3fb1d82c3 tempest-VolumesTransfersV355Test-413301890 None] Lock "cinder-e38b07bf-e12c-4f63-aa16-bb834be92e59-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Creating offline snapshot 4f39146c-0df1-4907-90f1-5dc1d4365b6d of volume cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[43867779-f6ea-4038-a946-25b394c37eca]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:12 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:12 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:13 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.449s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:13 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d 1G Jul 28 14:32:13 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:13 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d 1G" returned: 0 in 0.541s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb05b161-0c6a-4949-84c9-b03a1926311a -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:13 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb05b161-0c6a-4949-84c9-b03a1926311a -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:13 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:14 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb05b161-0c6a-4949-84c9-b03a1926311a -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.392s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:14 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d is being set with open permissions: ugo+rw Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:14 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:14 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:14 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:14 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info Jul 28 14:32:14 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:14 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:14 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info is being set with open permissions: ugo+rw Jul 28 14:32:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:14 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info Jul 28 14:32:14 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:15 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.info" returned: 0 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-85f99437-ecbc-4d95-9e21-d3eeb5dcd25c tempest-VolumeDependencyTests-1958317390 None] Create snapshot completed successfully Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Flow 'volume_create_manager' (2a608727-3a38-4c90-b9f6-3acfcdeb7ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7727e0f-472d-41e0-84d2-d4097531514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7727e0f-472d-41e0-84d2-d4097531514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-997220815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646902cabd0e496b9f77834057e16e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f39146c-0df1-4907-90f1-5dc1d4365b6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:17Z,use_quota=True,user_id='0f96bf5b70394aa483b1809b64e8ba08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7474f0b5-ed50-43a7-bb8a-00b838d5da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7474f0b5-ed50-43a7-bb8a-00b838d5da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652b249d-e37a-4f17-86a1-5587c29776ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652b249d-e37a-4f17-86a1-5587c29776ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3', 'volume_name': 'volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3', 'volume_size': 1, 'snapshot_id': '4f39146c-0df1-4907-90f1-5dc1d4365b6d'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94ead44-0196-4022-a05e-04fc7b1255c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94ead44-0196-4022-a05e-04fc7b1255c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566f9b8-0bf1-4ba6-96c9-f0e2d9aa2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:16 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Volume bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3', 'volume_size': 1, 'snapshot_id': '4f39146c-0df1-4907-90f1-5dc1d4365b6d'} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Creating volume bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 from snapshot 4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] snapshot: 4f39146c-0df1-4907-90f1-5dc1d4365b6d, volume: bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c18915-a850-4142-a528-0ac58ae10cf6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:16 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:16 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:17 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.473s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb05b161-0c6a-4949-84c9-b03a1926311a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf54f4d-6aa7-401d-9f7d-c5e14f1a46a2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:17 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:17 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:17 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:32:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:17 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 Jul 28 14:32:17 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Flow 'volume_create_manager' (53b2c888-0bb6-405e-b062-86b50690895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2939968-b735-433b-aeae-7cb5a8a8fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2939968-b735-433b-aeae-7cb5a8a8fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2082016487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42914314-b753-460a-8b7c-a1ebd2bf94c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc79e00b5634ef296839fcdc09a31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:19Z,use_quota=True,user_id='acf62e75b3ad4943a9c3a561955df541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b6434-5603-40bc-9734-23c7ae164728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b6434-5603-40bc-9734-23c7ae164728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d3ba14-7507-400a-a9ad-f1a48f18dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d3ba14-7507-400a-a9ad-f1a48f18dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42914314-b753-460a-8b7c-a1ebd2bf94c1', 'volume_name': 'volume-42914314-b753-460a-8b7c-a1ebd2bf94c1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2adfbf-c194-4d4d-a02b-e296bc2a67b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2adfbf-c194-4d4d-a02b-e296bc2a67b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea7bd34-5358-4db1-8792-72e8b5396121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Volume 42914314-b753-460a-8b7c-a1ebd2bf94c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42914314-b753-460a-8b7c-a1ebd2bf94c1', 'volume_size': 1} Jul 28 14:32:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Flow 'volume_create_manager' (8480223a-15c4-48b5-8486-5fadb79b8c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bb2634-3736-4ad5-b1db-a254d17ea728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bb2634-3736-4ad5-b1db-a254d17ea728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-324806259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7254888648edbf96f43ea8e4d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:21Z,use_quota=True,user_id='a469199b40334e74a30768cbb0dec6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1a55f2-9d75-4b79-b983-f1ddca17449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1a55f2-9d75-4b79-b983-f1ddca17449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81072fac-bcfb-4fab-9a92-c2d9d8ecd147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81072fac-bcfb-4fab-9a92-c2d9d8ecd147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'volume_name': 'volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc2c462-b6a5-478e-9a15-d1f8a562171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc2c462-b6a5-478e-9a15-d1f8a562171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a780a691-571f-44f0-9248-7a702127da6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Volume b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'volume_size': 1} Jul 28 14:32:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:23 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" returned: 0 in 5.334s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa2c517-cadd-463e-b26a-990abc187e1d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:23 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:23 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:23 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.522s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:32:23 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Converted 1024.00 MB image at 191.93 MB/s Jul 28 14:32:23 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 is being set with open permissions: ugo+rw Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:23 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 Jul 28 14:32:23 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:23 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" released by "_copy_volume_from_snapshot" :: held 7.097s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" released by "_create_volume_from_snapshot" :: held 7.131s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.157s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.431s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2082016487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42914314-b753-460a-8b7c-a1ebd2bf94c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc79e00b5634ef296839fcdc09a31f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:19Z,use_quota=True,user_id='acf62e75b3ad4943a9c3a561955df541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Creating volume 42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:23 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:23 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 1073741824 Jul 28 14:32:23 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-b8a52292-666a-4dd6-ab5f-28ee814a1aef req-1a14375b-3377-48c7-8658-3435d628a3fa tempest-AttachVolumeTestJSON-668992739 None] Terminate volume connection completed successfully. Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-b8a52292-666a-4dd6-ab5f-28ee814a1aef req-1a14375b-3377-48c7-8658-3435d628a3fa tempest-AttachVolumeTestJSON-668992739 None] Deleting attachment 4262b9e2-89e7-43b3-87bf-2a9695380e6f. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e566f9b8-0bf1-4ba6-96c9-f0e2d9aa2491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3', 'volume_size': 1, 'snapshot_id': '4f39146c-0df1-4907-90f1-5dc1d4365b6d'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ed479-096e-40c0-afba-f38a76604b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Volume volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 (bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3): created successfully Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ed479-096e-40c0-afba-f38a76604b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Flow 'volume_create_manager' (2a608727-3a38-4c90-b9f6-3acfcdeb7ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6dcd2d91-2b09-41ee-914c-39fa2b9047b3 tempest-VolumeDependencyTests-1958317390 None] Created volume successfully. Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-4f39146c-0df1-4907-90f1-5dc1d4365b6d-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:24 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 1073741824" returned: 0 in 0.485s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-4f39146c-0df1-4907-90f1-5dc1d4365b6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Deleting offline snapshot 4f39146c-0df1-4907-90f1-5dc1d4365b6d of volume cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] snapshot_file for this snap is: volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4127ab8-ae3c-4bf7-9b28-7359cf388176]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:24 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 Jul 28 14:32:24 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:24 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:24 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:24 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-324806259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7254888648edbf96f43ea8e4d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:21Z,use_quota=True,user_id='a469199b40334e74a30768cbb0dec6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Creating volume b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:24 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 1073741824 Jul 28 14:32:24 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea7bd34-5358-4db1-8792-72e8b5396121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42914314-b753-460a-8b7c-a1ebd2bf94c1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e46d827-56a6-4679-8a29-afa811249354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Volume volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 (42914314-b753-460a-8b7c-a1ebd2bf94c1): created successfully Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e46d827-56a6-4679-8a29-afa811249354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Flow 'volume_create_manager' (53b2c888-0bb6-405e-b062-86b50690895e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-35294ddd-3fb3-41e0-8a5a-954d7f4fda06 req-21818b63-557e-48d7-9c58-add67a151c3d tempest-VolumesSnapshotsTestJSON-1127473915 None] Created volume successfully. Jul 28 14:32:24 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.485s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb05b161-0c6a-4949-84c9-b03a1926311a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0260f-7a71-4be6-a9cd-4e104b793e3a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:25 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:25 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:25 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 1073741824" returned: 0 in 0.532s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:25 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:25 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:25 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:25 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:25 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:25 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.131s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a780a691-571f-44f0-9248-7a702127da6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c81ea8c-299f-4cf0-9660-13228ca54d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Creating offline snapshot 57b4f33b-3080-4cb3-9f55-6bbd99b077e6 of volume 42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:32:25 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Volume volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 (b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7): created successfully Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c81ea8c-299f-4cf0-9660-13228ca54d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Flow 'volume_create_manager' (8480223a-15c4-48b5-8486-5fadb79b8c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bae67e-fb9c-4182-96db-3a7e1e842b70]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-729ec26e-995e-4d43-babc-6830b7d21017 tempest-VolumesCloneTest-1077916934 None] Created volume successfully. Jul 28 14:32:25 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:25 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d Jul 28 14:32:25 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:25 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 Jul 28 14:32:25 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:26 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a.4f39146c-0df1-4907-90f1-5dc1d4365b6d" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-4f39146c-0df1-4907-90f1-5dc1d4365b6d" released by "_delete_snapshot" :: held 1.703s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:26 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" released by "delete_snapshot" :: held 1.738s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1" returned: 0 in 0.417s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:26 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 1G Jul 28 14:32:26 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Created reservations ['476e1ae5-1a9a-4749-b5d1-977e10ee7514', '3db53f34-cea9-4f62-8dfb-88708ab55d5d', 'c8e82135-c844-4006-97b4-19abb8f006dc', '4602df31-f5a9-4a83-933a-940015a2e1a4'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Delete snapshot completed successfully. Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7ec81ddb-0039-46b4-88ed-3fb707f19809 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-4f39146c-0df1-4907-90f1-5dc1d4365b6d-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-cb05b161-0c6a-4949-84c9-b03a1926311a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-cb05b161-0c6a-4949-84c9-b03a1926311a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:26 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 1G" returned: 0 in 0.616s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:26 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 Jul 28 14:32:26 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" acquired by "delete_volume" :: waited 0.044s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Flow 'volume_create_manager' (cce1e783-472c-4b42-a9e5-21db4aea2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cbda1c-8893-4c18-b7ce-995a8de1c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a14405e-ed52-4349-bf88-9b377ae35044]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cbda1c-8893-4c18-b7ce-995a8de1c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1644758592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abb7254888648edbf96f43ea8e4d219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:27Z,use_quota=True,user_id='a469199b40334e74a30768cbb0dec6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2e6845-229a-45e9-9595-aeedd1baabe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2e6845-229a-45e9-9595-aeedd1baabe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89c5d95-368f-46c5-b3e1-9aa828d3677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89c5d95-368f-46c5-b3e1-9aa828d3677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4', 'volume_name': 'volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4', 'volume_size': 2, 'source_volid': 'b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'source_volstatus': 'available'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c3c862-9d56-42ab-aa42-2dd4035c8b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c3c862-9d56-42ab-aa42-2dd4035c8b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f72da9-1d30-4725-a1bb-52b7aed1d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Volume 0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4', 'volume_size': 2, 'source_volid': 'b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'source_volstatus': 'available'} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:27 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:27 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:27 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:27 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 is being set with open permissions: ugo+rw Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:27 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 Jul 28 14:32:27 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:27 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:27 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a Jul 28 14:32:27 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:27 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:27 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info Jul 28 14:32:27 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:27 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cb05b161-0c6a-4949-84c9-b03a1926311a" returned: 0 in 0.374s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-cb05b161-0c6a-4949-84c9-b03a1926311a" released by "delete_volume" :: held 0.907s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:27 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Created reservations ['833baa48-0def-4dee-814b-fd9cfa00b6bb', '59ff276c-cd46-47b9-a2d8-b87ccd5a5348', '512b3650-67fc-4f1f-92eb-161187c2c634', 'cf7f8aec-31b1-4b96-a14c-c0f9ecb11365'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:28 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info" returned: 0 in 0.417s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:28 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info is being set with open permissions: ugo+rw Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:28 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:28 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:28 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info Jul 28 14:32:28 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:28 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Deleted volume successfully. Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2dc6746f-27f8-48eb-b74c-6a0d535292c5 tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-cb05b161-0c6a-4949-84c9-b03a1926311a-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:28 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.info" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.365s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:28 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Cloning volume b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 to volume 0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 Jul 28 14:32:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-58503868-1d13-43ec-b4ea-95aa9293ee7e req-f48a59a0-91af-4a9a-b200-7c76f7730975 tempest-VolumesSnapshotsTestJSON-1127473915 None] Create snapshot completed successfully Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Creating offline snapshot e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 of volume b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0566e582-4a0e-45c5-82c1-f5b357d04bd8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:28 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:28 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:28 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.493s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:29 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 1G Jul 28 14:32:29 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0fddd1-7e0c-4345-af7c-7c618fcae623]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "cinder-57b4f33b-3080-4cb3-9f55-6bbd99b077e6-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-57b4f33b-3080-4cb3-9f55-6bbd99b077e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "cinder-quobyte-57b4f33b-3080-4cb3-9f55-6bbd99b077e6" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-57b4f33b-3080-4cb3-9f55-6bbd99b077e6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Deleting offline snapshot 57b4f33b-3080-4cb3-9f55-6bbd99b077e6 of volume 42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:32:29 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 Jul 28 14:32:29 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] snapshot_file for this snap is: volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1444ab-8818-4af9-92c1-c2b8838a53f2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:29 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 Jul 28 14:32:29 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:29 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 1G" returned: 0 in 0.747s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:29 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:29 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:29 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" returned: 0 in 0.674s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:29 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3 Jul 28 14:32:29 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:29 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42914314-b753-460a-8b7c-a1ebd2bf94c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad0157-dcd8-47c6-a1d2-78cbe29e3573]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 is being set with open permissions: ugo+rw Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 Jul 28 14:32:30 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:30 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:30 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:30 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-quobyte-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3" released by "delete_volume" :: held 1.075s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Created reservations ['4efd3278-5ea0-4438-8b76-5ec9a54817a4', '5d011f9a-48bf-4a3e-88f9-75ee28a35777', '3ffa5d52-2148-4943-87a3-0ff91f16b6bd', '74013a03-16fb-4b75-af10-ce465899a425'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:30 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:30 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.328s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1" returned: 0 in 0.442s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 Jul 28 14:32:30 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:30 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info Jul 28 14:32:30 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:30 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.281s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Deleted volume successfully. Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ea5c2d7c-f93f-4443-9a43-030e9f9bc3fd tempest-VolumeDependencyTests-1958317390 None] Lock "cinder-bbdac98f-86bc-4e57-b7e7-d3bf2a80b6d3-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:30 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info" returned: 0 in 0.335s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:30 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info is being set with open permissions: ugo+rw Jul 28 14:32:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:30 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info Jul 28 14:32:30 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:31 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6" returned: 0 in 0.578s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:31 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6 Jul 28 14:32:31 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:31 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.info" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] snapshot: e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167, volume: 0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d37d7-c8c6-49a3-aad0-7e00aadfc3c9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:31 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1.57b4f33b-3080-4cb3-9f55-6bbd99b077e6" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-57b4f33b-3080-4cb3-9f55-6bbd99b077e6" released by "_delete_snapshot" :: held 2.036s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:31 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:31 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" released by "delete_snapshot" :: held 2.071s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.quota [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Created reservations ['815cdea5-f0e4-46db-84e1-2454365e29db', '08b5f52a-a259-4379-89f2-95299098c204', 'd3d22eaf-44b6-4b4e-9d22-433ee04be821', '5787c8bb-5687-484c-babf-daebc9f9b9e7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Delete snapshot completed successfully. Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-71114f1f-d7b9-4ca0-a862-20a9fd8e9949 req-193df78c-b1ba-4ffd-809a-1984ea32c30a tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-57b4f33b-3080-4cb3-9f55-6bbd99b077e6-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "cinder-42914314-b753-460a-8b7c-a1ebd2bf94c1-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-42914314-b753-460a-8b7c-a1ebd2bf94c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:31 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8675e88-51b3-42d8-845d-6efa870a311f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[940df91d-6cbd-463a-9c1d-36c4ef46f966]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:32 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:32 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:32 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 Jul 28 14:32:32 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:32 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.505s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:32 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:32:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:32 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 Jul 28 14:32:32 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:32 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1" returned: 0 in 0.642s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:32 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1 Jul 28 14:32:32 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:33 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-42914314-b753-460a-8b7c-a1ebd2bf94c1" returned: 0 in 0.412s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-quobyte-42914314-b753-460a-8b7c-a1ebd2bf94c1" released by "delete_volume" :: held 1.151s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG cinder.quota [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Created reservations ['376ab2a5-1602-4e4b-b979-3d541423f0a1', '791fc4b7-c0ba-45e5-92ea-ee456372e3da', '87177822-7a87-4bca-a8a8-93bcd16e04a4', '9c0c1fec-8f2e-439a-a190-d826ef169c65'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:33 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:33 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:34 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.687s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:34 devstack cinder-volume[87385]: DEBUG cinder.manager [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Deleted volume successfully. Jul 28 14:32:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-e0808f8d-304b-43c8-bc1a-662317fd716b req-d8a83cbe-74a3-43b2-900e-62ffcad6cf84 tempest-VolumesSnapshotsTestJSON-1127473915 None] Lock "cinder-42914314-b753-460a-8b7c-a1ebd2bf94c1-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:39 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" returned: 0 in 6.859s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b8a38a-93c9-4069-9b38-445e2292c540]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:39 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:39 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Flow 'volume_create_manager' (f32e7520-b2ad-4ebf-9d7c-41e7392f19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17fe7b5-d5a2-4f4a-b449-7bf1bd7d8272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17fe7b5-d5a2-4f4a-b449-7bf1bd7d8272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add7af2b-c412-48a9-9d95-0a957be5a155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf039701a95f4226b303a83cbd0e1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:40Z,use_quota=True,user_id='ce4efa1eef3c4f6787cac8eb2e47dfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abde684d-cfab-40e7-9175-23a0404de877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abde684d-cfab-40e7-9175-23a0404de877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b045f672-675c-4664-bf44-9ca23da1a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b045f672-675c-4664-bf44-9ca23da1a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add7af2b-c412-48a9-9d95-0a957be5a155', 'volume_name': 'volume-add7af2b-c412-48a9-9d95-0a957be5a155', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dc80e7-e6f0-4d57-899b-b9f9f4bf30b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85dc80e7-e6f0-4d57-899b-b9f9f4bf30b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba208d-c4f9-4acb-b4d6-475f731690ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Volume add7af2b-c412-48a9-9d95-0a957be5a155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add7af2b-c412-48a9-9d95-0a957be5a155', 'volume_size': 1} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:40 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.733s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:32:40 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Converted 1024.00 MB image at 149.26 MB/s Jul 28 14:32:40 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 is being set with open permissions: ugo+rw Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:40 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 Jul 28 14:32:40 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:40 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" released by "_copy_volume_from_snapshot" :: held 9.048s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-quobyte-e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Deleting offline snapshot e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 of volume b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] snapshot_file for this snap is: volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9016fe7e-57a0-4399-89e3-0381c203f1e4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:40 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:40 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:40 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.414s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75e2fa8-b314-4aa8-a7b3-b6614616bd19]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:41 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:41 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:41 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.398s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:41 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:41 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:41 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.381s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:41 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167 Jul 28 14:32:41 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:41 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7.e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-e161eb4a-8cf5-4c00-aa47-3d8f9ebbc167" released by "_delete_snapshot" :: held 1.586s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.623s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add7af2b-c412-48a9-9d95-0a957be5a155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf039701a95f4226b303a83cbd0e1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:40Z,use_quota=True,user_id='ce4efa1eef3c4f6787cac8eb2e47dfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Creating volume add7af2b-c412-48a9-9d95-0a957be5a155 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:42 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f72da9-1d30-4725-a1bb-52b7aed1d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4', 'volume_size': 2, 'source_volid': 'b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7', 'source_volstatus': 'available'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:42 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 1073741824 Jul 28 14:32:42 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd2f14c-8d47-474f-8db3-d70147b6b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Volume volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 (0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4): created successfully Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd2f14c-8d47-474f-8db3-d70147b6b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Flow 'volume_create_manager' (cce1e783-472c-4b42-a9e5-21db4aea2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-da068ad0-8b5c-4f78-ac12-80aa58b961d2 tempest-VolumesCloneTest-1077916934 None] Created volume successfully. Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:42 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 1073741824" returned: 0 in 0.569s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:42 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 Jul 28 14:32:42 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7783a7ef-062d-47c8-80f3-06b12bd912ef]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:42 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 Jul 28 14:32:42 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:43 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aba208d-c4f9-4acb-b4d6-475f731690ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add7af2b-c412-48a9-9d95-0a957be5a155', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5c2b94-147d-4109-9073-038d7be3e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:43 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Volume volume-add7af2b-c412-48a9-9d95-0a957be5a155 (add7af2b-c412-48a9-9d95-0a957be5a155): created successfully Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5c2b94-147d-4109-9073-038d7be3e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Flow 'volume_create_manager' (f32e7520-b2ad-4ebf-9d7c-41e7392f19de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-efc31d25-633f-417f-8d76-6e25354f2dd4 tempest-CinderUnicodeTest-1673460483 None] Created volume successfully. Jul 28 14:32:43 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" returned: 0 in 0.468s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:43 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4 Jul 28 14:32:43 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:43 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4" released by "delete_volume" :: held 0.857s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Created reservations ['304fa88d-bc15-476a-9d53-01213ff397dc', 'eef15647-f442-46a4-abe7-7541055c06d1', '77e64d99-f3a4-4072-85d1-9a215d6cdc1f', '09295626-3dd3-4469-939a-a91c11e78e70'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:43 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:43 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "cinder-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Acquiring lock "cinder-quobyte-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:44 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.373s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:44 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Deleted volume successfully. Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[379505b0-ced7-4dd9-ad8d-c2a428d7bd80]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3006c4cb-3b1c-4f54-bc84-d4fba346b8b3 tempest-VolumesCloneTest-1077916934 None] Lock "cinder-0526f0e5-792a-45d2-8bf9-84f1c1b8b4c4-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:44 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:44 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:44 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.388s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:44 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7 Jul 28 14:32:44 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:44 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "cinder-quobyte-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7" released by "delete_volume" :: held 0.757s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Flow 'volume_create_manager' (96344e4a-ddd4-4622-b250-48b759c16401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b30967-584b-4656-92e8-30165741f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b30967-584b-4656-92e8-30165741f28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1592174565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2e6e77-7506-427a-9849-09746734d472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf039701a95f4226b303a83cbd0e1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:45Z,use_quota=True,user_id='ce4efa1eef3c4f6787cac8eb2e47dfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04dde43-7c2d-498e-9e60-0218fad89ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04dde43-7c2d-498e-9e60-0218fad89ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5040a660-fceb-4f04-b5bc-45d33974cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5040a660-fceb-4f04-b5bc-45d33974cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2e6e77-7506-427a-9849-09746734d472', 'volume_name': 'volume-9d2e6e77-7506-427a-9849-09746734d472', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91683c59-2df9-4894-a702-9235217fb944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91683c59-2df9-4894-a702-9235217fb944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7405fee1-ef96-428b-87cb-27a25ea6bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:44 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Volume 9d2e6e77-7506-427a-9849-09746734d472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2e6e77-7506-427a-9849-09746734d472', 'volume_size': 1} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1592174565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2e6e77-7506-427a-9849-09746734d472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf039701a95f4226b303a83cbd0e1ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:45Z,use_quota=True,user_id='ce4efa1eef3c4f6787cac8eb2e47dfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Creating volume 9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:44 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:44 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 1073741824 Jul 28 14:32:44 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:44 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Created reservations ['3a252715-cbb4-40fb-8d8f-097ab31aa098', 'd8d2445f-28ef-45f5-9ae7-ca36e3038b21', '42f94c9f-376f-4416-8bd0-5f0786c95cd5', '55b2e01f-3e42-4930-a0ef-cf6fcf8bded5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:45 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:45 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:45 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Deleted volume successfully. Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3ecef297-bbe9-4c35-a0a8-4645c03ac22d tempest-VolumesCloneTest-1077916934 None] Lock "cinder-b9fe37f2-62ac-40ce-ba2f-c3ec3080fdc7-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:45 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 1073741824" returned: 0 in 0.526s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:45 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 Jul 28 14:32:45 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:45 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7405fee1-ef96-428b-87cb-27a25ea6bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2e6e77-7506-427a-9849-09746734d472', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a990ee4-e314-4950-a2c3-06b435783578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Volume volume-9d2e6e77-7506-427a-9849-09746734d472 (9d2e6e77-7506-427a-9849-09746734d472): created successfully Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a990ee4-e314-4950-a2c3-06b435783578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Flow 'volume_create_manager' (96344e4a-ddd4-4622-b250-48b759c16401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-5e099091-b85a-4572-b7ea-e817c5f543dd tempest-CinderUnicodeTest-1673460483 None] Created volume successfully. Jul 28 14:32:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a875acd-b0d8-4c72-a8a9-8931424f24df tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-302705296: creating Jul 28 14:32:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a875acd-b0d8-4c72-a8a9-8931424f24df tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-302705296: created successfully Jul 28 14:32:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a875acd-b0d8-4c72-a8a9-8931424f24df tempest-GroupSnapshotsTest-1530526815 None] Create group completed successfully. Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Creating offline snapshot 45c7d43a-7227-4e38-b458-97cfce989ba9 of volume 9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6114b58d-97f3-4a82-b8e3-c2ffbc4af33b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:47 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 Jul 28 14:32:47 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:47 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472" returned: 0 in 0.396s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:47 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 1G Jul 28 14:32:47 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:48 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 1G" returned: 0 in 0.470s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2e6e77-7506-427a-9849-09746734d472 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:48 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2e6e77-7506-427a-9849-09746734d472 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 Jul 28 14:32:48 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:48 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2e6e77-7506-427a-9849-09746734d472 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9" returned: 0 in 0.341s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:48 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 is being set with open permissions: ugo+rw Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:48 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 Jul 28 14:32:48 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (7b869076-b7fb-409d-9412-dd7ab747bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:48 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e8bfcc-7dbc-42f4-b420-a9246bceaa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e8bfcc-7dbc-42f4-b420-a9246bceaa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951623662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57605ea4-51a6-44df-9bb7-8fa198549bfa,host='devstack@QuobyteHD#QuobyteHD',id=94256a01-6afb-48e3-9c23-c756a4ae0cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:48Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52e1851b-fb1d-4fa5-9c17-05fa7436e65c),volume_type_id=52e1851b-fb1d-4fa5-9c17-05fa7436e65c)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd84654-cf74-46dd-9d46-be51f405d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd84654-cf74-46dd-9d46-be51f405d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6c9c60-d6b4-45c7-9505-9de0528b1940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6c9c60-d6b4-45c7-9505-9de0528b1940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94256a01-6afb-48e3-9c23-c756a4ae0cf7', 'volume_name': 'volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24295136-5c5e-48be-98c2-6f0023752807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24295136-5c5e-48be-98c2-6f0023752807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcada2b6-d637-4af6-9f6f-ee900be4735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Volume 94256a01-6afb-48e3-9c23-c756a4ae0cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7', 'volume_size': 1} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Flow 'volume_create_manager' (89f3131b-c5f4-4f4f-a56b-13e89966e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c1c616-04e3-4493-a9c5-e2d39c8050a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c1c616-04e3-4493-a9c5-e2d39c8050a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1698532399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38a88b0-6531-4694-b9d6-8a1154bb8554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1e9dd7aaea44158b4a8fc73e49cdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:49Z,use_quota=True,user_id='17707f0a4803426abf20b3ca8bdb4308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d06504-53ab-4a62-9055-bf0597c1622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d06504-53ab-4a62-9055-bf0597c1622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a06b5a-78d9-4cbe-b232-4b2e6dae7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a06b5a-78d9-4cbe-b232-4b2e6dae7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38a88b0-6531-4694-b9d6-8a1154bb8554', 'volume_name': 'volume-d38a88b0-6531-4694-b9d6-8a1154bb8554', 'volume_size': 2}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf75693-0e80-423c-9af0-ca066819a985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf75693-0e80-423c-9af0-ca066819a985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4a4ae7-f608-44c7-9a54-1bf5ddd43b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:48 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Volume d38a88b0-6531-4694-b9d6-8a1154bb8554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38a88b0-6531-4694-b9d6-8a1154bb8554', 'volume_size': 2} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:48 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info Jul 28 14:32:48 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:49 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info" returned: 0 in 0.247s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:49 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info is being set with open permissions: ugo+rw Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:49 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info Jul 28 14:32:49 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 28 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:32:49 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.info" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57605ea4-51a6-44df-9bb7-8fa198549bfa,created_at=2026-07-28T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951623662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57605ea4-51a6-44df-9bb7-8fa198549bfa,host='devstack@QuobyteHD#QuobyteHD',id=94256a01-6afb-48e3-9c23-c756a4ae0cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:48Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52e1851b-fb1d-4fa5-9c17-05fa7436e65c),volume_type_id=52e1851b-fb1d-4fa5-9c17-05fa7436e65c)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Creating volume 94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:49 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:49 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 1073741824 Jul 28 14:32:49 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b8270b22-e6ac-4352-93d9-711162fb66d5 tempest-CinderUnicodeTest-1673460483 None] Create snapshot completed successfully Jul 28 14:32:49 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 1073741824" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:49 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:32:49 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:50 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.250s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1698532399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38a88b0-6531-4694-b9d6-8a1154bb8554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1e9dd7aaea44158b4a8fc73e49cdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:49Z,use_quota=True,user_id='17707f0a4803426abf20b3ca8bdb4308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Creating volume d38a88b0-6531-4694-b9d6-8a1154bb8554 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:50 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 2147483648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcada2b6-d637-4af6-9f6f-ee900be4735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:50 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 2147483648 Jul 28 14:32:50 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e33e0-5aa6-4e2b-98a7-62a9c9eef9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:50 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Volume volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 (94256a01-6afb-48e3-9c23-c756a4ae0cf7): created successfully Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084e33e0-5aa6-4e2b-98a7-62a9c9eef9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (7b869076-b7fb-409d-9412-dd7ab747bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:50 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-505f6716-7d5c-41e6-8d10-e9a5a1e0be94 tempest-GroupSnapshotsTest-1530526815 None] Created volume successfully. Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-45c7d43a-7227-4e38-b458-97cfce989ba9-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-45c7d43a-7227-4e38-b458-97cfce989ba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-quobyte-45c7d43a-7227-4e38-b458-97cfce989ba9" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-45c7d43a-7227-4e38-b458-97cfce989ba9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Deleting offline snapshot 45c7d43a-7227-4e38-b458-97cfce989ba9 of volume 9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] snapshot_file for this snap is: volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0376c9-5a96-4230-ac33-a9d939e55dff]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:50 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 2147483648" returned: 0 in 0.549s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:50 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 Jul 28 14:32:50 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:50 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 Jul 28 14:32:50 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:51 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4a4ae7-f608-44c7-9a54-1bf5ddd43b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38a88b0-6531-4694-b9d6-8a1154bb8554', 'volume_size': 2}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d35fd0-f2f3-4859-b56f-fa9478b46df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:51 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Volume volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 (d38a88b0-6531-4694-b9d6-8a1154bb8554): created successfully Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d35fd0-f2f3-4859-b56f-fa9478b46df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Flow 'volume_create_manager' (89f3131b-c5f4-4f4f-a56b-13e89966e30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1893f85b-2910-4eaf-bf70-48b5a687b14f tempest-VolumesCloneNegativeTest-1802422397 None] Created volume successfully. Jul 28 14:32:51 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9" returned: 0 in 0.482s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2e6e77-7506-427a-9849-09746734d472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[894ecb3c-5534-4d1b-b731-6032981c730b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] GroupSnapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: creating. Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Group snapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: creating. {{(pid=87385) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Creating offline snapshot 5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 of volume 94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:32:51 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 Jul 28 14:32:51 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a9dbc-718c-4674-ae3d-1088fc34dce2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:51 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:32:51 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:51 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472" returned: 0 in 0.488s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:51 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 Jul 28 14:32:51 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:51 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.415s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:51 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 1G Jul 28 14:32:51 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Acquiring lock "cinder-d38a88b0-6531-4694-b9d6-8a1154bb8554-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "cinder-d38a88b0-6531-4694-b9d6-8a1154bb8554-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Acquiring lock "cinder-quobyte-d38a88b0-6531-4694-b9d6-8a1154bb8554" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "cinder-quobyte-d38a88b0-6531-4694-b9d6-8a1154bb8554" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc431229-55ca-468c-8df9-1d54a1fdf3ca]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9 Jul 28 14:32:52 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:52 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 Jul 28 14:32:52 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:52 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 1G" returned: 0 in 0.489s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:32:52 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:52 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472.45c7d43a-7227-4e38-b458-97cfce989ba9" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-45c7d43a-7227-4e38-b458-97cfce989ba9" released by "_delete_snapshot" :: held 1.786s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" released by "delete_snapshot" :: held 1.808s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:52 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554 Jul 28 14:32:52 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Created reservations ['746f4cd6-9550-4f95-a7b4-40361bece86b', 'c9589229-add4-4056-98e8-408735ba9ce1', '1bf84caf-3b2e-4690-9f5b-11170f989522', 'd1fcd6c4-482f-48ab-8e8a-d14f77d1dfe1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Delete snapshot completed successfully. Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-215b816e-18d8-43e6-9515-829fd47de91f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-45c7d43a-7227-4e38-b458-97cfce989ba9-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:52 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:32:52 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:52 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-9d2e6e77-7506-427a-9849-09746734d472-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d38a88b0-6531-4694-b9d6-8a1154bb8554" returned: 0 in 0.301s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "cinder-quobyte-d38a88b0-6531-4694-b9d6-8a1154bb8554" released by "delete_volume" :: held 0.764s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-9d2e6e77-7506-427a-9849-09746734d472-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Created reservations ['af09ee79-a90b-4cce-b1fa-5e14c61cafd2', '38e38abb-dade-4690-a29a-d7a69ae76e9a', 'feff4ba9-bfcd-4f4c-8d34-ba41c80ad6d0', '5cb2a8a3-aff9-4a3a-b596-50c3e84b4570'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:52 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0562187a-7a42-4e4d-8bbc-a8df1ef59ea7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:52 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info Jul 28 14:32:52 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:53 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 Jul 28 14:32:53 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:53 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:53 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:53 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:53 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:53 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info Jul 28 14:32:53 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:53 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.431s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Deleted volume successfully. Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-43f7b378-0a22-487c-a7e2-fbc38e3206de tempest-VolumesCloneNegativeTest-1802422397 None] Lock "cinder-d38a88b0-6531-4694-b9d6-8a1154bb8554-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:53 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472" returned: 0 in 0.706s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:53 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.info" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:53 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472 Jul 28 14:32:53 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-89d9ae96-38a8-4764-ae05-9d3b6ffc0518 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: created successfully Jul 28 14:32:54 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9d2e6e77-7506-427a-9849-09746734d472" returned: 0 in 0.510s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-9d2e6e77-7506-427a-9849-09746734d472" released by "delete_volume" :: held 1.305s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Created reservations ['a398708f-b500-43a7-8ea1-7cce1943baf4', 'fcba45c4-4157-4c40-924b-bdda0a26d215', '2c6dde8f-f01e-44b4-97e7-453dfa8e4d52', '83edf9c9-1a1c-4b59-afa0-a24efb424cab'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:54 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:54 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:54 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.331s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Deleted volume successfully. Jul 28 14:32:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14122396-e850-4cbc-8b3a-028bc0e7e72f tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-9d2e6e77-7506-427a-9849-09746734d472-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-add7af2b-c412-48a9-9d95-0a957be5a155-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-add7af2b-c412-48a9-9d95-0a957be5a155-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "cinder-quobyte-add7af2b-c412-48a9-9d95-0a957be5a155" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-add7af2b-c412-48a9-9d95-0a957be5a155" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e473f6-4c4d-4701-930b-f1c9f0a5ea66]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:55 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 Jul 28 14:32:55 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2-4ef6877c-ec55-49b1-81ec-de7c26e15621" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2-4ef6877c-ec55-49b1-81ec-de7c26e15621" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Creating volume 4ef6877c-ec55-49b1-81ec-de7c26e15621 from snapshot 5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] snapshot: 5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2, volume: 4ef6877c-ec55-49b1-81ec-de7c26e15621, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98797b4-a1c9-4ff4-bbe0-4d69382c38ff]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:55 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155" returned: 0 in 0.628s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:56 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:32:56 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:56 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155 Jul 28 14:32:56 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:56 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-add7af2b-c412-48a9-9d95-0a957be5a155" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:56 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.494s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-quobyte-add7af2b-c412-48a9-9d95-0a957be5a155" released by "delete_volume" :: held 1.069s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9ad975-46a0-4010-b2a2-8afb7ee5c676]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Created reservations ['c60e9602-1031-4b2a-b0ae-212aeebe5a42', '726e7c8f-f558-4db2-a984-e7e9aa082ed1', '7fce83c5-6a4e-47db-a806-9590b559ced7', '8c3560e7-bc39-4c32-bc41-2a9b3c648f81'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:32:56 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:32:56 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:56 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:32:56 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:56 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.475s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:32:56 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.346s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:32:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Deleted volume successfully. Jul 28 14:32:56 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 Jul 28 14:32:56 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:32:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-7a8353c9-4a97-4560-85b2-db4e69bb1c21 tempest-CinderUnicodeTest-1673460483 None] Lock "cinder-add7af2b-c412-48a9-9d95-0a957be5a155-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Flow 'volume_create_manager' (4aea9c07-6118-4295-aa30-bea5cad6d1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a603b64-1bb0-46a7-a4ae-438cb6257a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a603b64-1bb0-46a7-a4ae-438cb6257a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-724239293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5de24e3-c59a-46e7-9c15-d8e99a5881d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8a6213e854c12831827f3a5d46e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:59Z,use_quota=True,user_id='6a1baaf190604b0e9d5373ccff7f7105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c9f88-4f81-427c-a55d-5f1cd496734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c9f88-4f81-427c-a55d-5f1cd496734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f4a10a-34e5-45d6-b2da-e9dbbf701287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:32:59 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:33:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f4a10a-34e5-45d6-b2da-e9dbbf701287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5de24e3-c59a-46e7-9c15-d8e99a5881d0', 'volume_name': 'volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8a0293-0d56-4d38-bc52-2db51ff2aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8a0293-0d56-4d38-bc52-2db51ff2aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf83d3-0e0e-4d93-bf72-c8f9f71cffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 14:33:00 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Trying to clone a5de24e3-c59a-46e7-9c15-d8e99a5881d0 from image b313c492-604e-4cdd-96f9-0cabb9f2068f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:33:01 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:33:01 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Image download 20.69 MB at 20.69 MB/s Jul 28 14:33:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9eb18c-3717-4194-85a5-17314fb7ebe9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:01 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD Jul 28 14:33:01 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:02 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f is fetched for user 6a1baaf190604b0e9d5373ccff7f7105. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=129,cinder:UPDATE=156,cinder:DELETE=18,cinder:INSERT=36 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=123,cinder:UPDATE=152,cinder:INSERT=40,cinder:DELETE=8 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[818abd75-d2c7-40a4-abec-a01701a05438]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:02 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD Jul 28 14:33:02 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:03 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621" returned: 0 in 6.448s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d38e3-8bc6-469a-9a29-c7e3e35007d7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:03 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:03 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:33:03 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:03 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.612s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:33:03 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Converted 1024.00 MB image at 158.78 MB/s Jul 28 14:33:03 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:03 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 Jul 28 14:33:03 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:04 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" released by "_copy_volume_from_snapshot" :: held 8.433s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2-4ef6877c-ec55-49b1-81ec-de7c26e15621" released by "_create_volume_from_snapshot" :: held 8.486s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.516s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-724239293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5de24e3-c59a-46e7-9c15-d8e99a5881d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8a6213e854c12831827f3a5d46e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:32:59Z,use_quota=True,user_id='6a1baaf190604b0e9d5373ccff7f7105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Creating volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:04 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:04 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1073741824 Jul 28 14:33:04 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4ab06038-9a23-4f60-b54f-5d4b25d53044 tempest-GroupSnapshotsTest-1530526815 None] Create group from source-snapshot-6e9c4210-be28-4e43-a2a9-2fe86bb18b39 completed successfully. Jul 28 14:33:04 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1073741824" returned: 0 in 0.528s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:04 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 Jul 28 14:33:04 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6fff3b-0b5e-42d3-b1e8-ea01fd6f8dca]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:05 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Attempting download of b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed947c-bb6a-4a3f-99b8-673f9d1c5c36]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:05 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 Jul 28 14:33:05 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx Jul 28 14:33:05 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621" returned: 0 in 0.562s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:05 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx" returned: 0 in 0.440s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:05 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621 Jul 28 14:33:05 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Flow 'volume_create_manager' (54727c06-1261-46eb-a63b-3bcbc9732fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09cb026-e66d-4575-b3f7-2a6efd0670f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09cb026-e66d-4575-b3f7-2a6efd0670f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319388653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b73531-a901-4106-b042-1d823917ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8df3bd804af45ed9c7c25ee36a6b848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:06Z,use_quota=True,user_id='a59caf255a954149961999a044deb4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1651e0-82ff-4d14-af39-cdb62d428d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:05 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx Jul 28 14:33:05 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1651e0-82ff-4d14-af39-cdb62d428d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bf046c-d273-4d3e-883c-f8acdb9f8405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bf046c-d273-4d3e-883c-f8acdb9f8405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b73531-a901-4106-b042-1d823917ed21', 'volume_name': 'volume-e2b73531-a901-4106-b042-1d823917ed21', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0a9a19-2707-4d93-b7a9-de9d0cda4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0a9a19-2707-4d93-b7a9-de9d0cda4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32bfae3-c6d6-4cfb-bb0a-097ecbc169dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Volume e2b73531-a901-4106-b042-1d823917ed21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b73531-a901-4106-b042-1d823917ed21', 'volume_size': 1} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-319388653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b73531-a901-4106-b042-1d823917ed21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8df3bd804af45ed9c7c25ee36a6b848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:06Z,use_quota=True,user_id='a59caf255a954149961999a044deb4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Creating volume e2b73531-a901-4106-b042-1d823917ed21 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:05 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:05 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 1073741824 Jul 28 14:33:05 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:05 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4ef6877c-ec55-49b1-81ec-de7c26e15621" returned: 0 in 0.323s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-4ef6877c-ec55-49b1-81ec-de7c26e15621" released by "delete_volume" :: held 0.956s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['4f2a62f9-73fe-4d3a-ae43-7fa378e1eadc'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:06 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx" returned: 1 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f__r2hzkyx' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c4b70d-f70d-44d8-a733-89a6ec66c26e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:06 devstack cinder-volume[87385]: WARNING cinder.quota [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1428036568 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1428036568, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:06 devstack cinder-volume[87385]: WARNING cinder.quota [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1428036568 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1428036568, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['4e090ab7-e01d-4864-8c26-1dfe5d427c9d', '82bd0f37-d75d-42a4-91b7-de5022c751d4', 'd69e64a2-4e2d-46e3-8498-a97cc2dfa624', 'e35ebb6b-693d-4bc1-891a-0ba2f292dfea'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:06 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD Jul 28 14:33:06 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:06 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 1073741824" returned: 0 in 0.708s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:06 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:06 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:06 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 Jul 28 14:33:06 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:06 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] b313c492-604e-4cdd-96f9-0cabb9f2068f was qcow2, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: deleting Jul 28 14:33:06 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 Jul 28 14:33:06 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: deleting {{(pid=87385) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 14:33:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Deleting offline snapshot 5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 of volume 94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] snapshot_file for this snap is: volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[84362b02-a081-4f9c-a113-d42c660f5794]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:07 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.636s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:07 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21" returned: 0 in 0.514s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-16e5a095-3739-406c-bbf8-a54f8960c8a8 tempest-GroupSnapshotsTest-1530526815 None] Delete group completed successfully. Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32bfae3-c6d6-4cfb-bb0a-097ecbc169dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b73531-a901-4106-b042-1d823917ed21', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccae0ad-e3c3-4715-ac86-58043bf13635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Volume volume-e2b73531-a901-4106-b042-1d823917ed21 (e2b73531-a901-4106-b042-1d823917ed21): created successfully Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccae0ad-e3c3-4715-ac86-58043bf13635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Flow 'volume_create_manager' (54727c06-1261-46eb-a63b-3bcbc9732fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-fde9feb7-16ed-4ec0-b007-bba4ba4d7c8a tempest-ProjectReaderTests-55820395 None] Created volume successfully. Jul 28 14:33:07 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:33:07 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:07 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.734s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa66357-1f49-4009-99fb-eeae98c45f0f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:08 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:33:08 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Acquiring lock "cinder-e2b73531-a901-4106-b042-1d823917ed21-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "cinder-e2b73531-a901-4106-b042-1d823917ed21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Acquiring lock "cinder-quobyte-e2b73531-a901-4106-b042-1d823917ed21" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "cinder-quobyte-e2b73531-a901-4106-b042-1d823917ed21" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea92c682-be93-45eb-ad7f-d8452b20dd11]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:08 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.536s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:08 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 Jul 28 14:33:08 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:08 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:33:08 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:08 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21" returned: 0 in 0.608s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:08 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.480s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:08 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21 Jul 28 14:33:08 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:08 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2 Jul 28 14:33:08 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:09 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7.5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-5ebf7bce-84dc-4cf1-8c14-635b2deaf4f2" released by "_delete_snapshot" :: held 2.207s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:09 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e2b73531-a901-4106-b042-1d823917ed21" returned: 0 in 0.373s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" released by "delete_snapshot" :: held 2.259s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "cinder-quobyte-e2b73531-a901-4106-b042-1d823917ed21" released by "delete_volume" :: held 1.058s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Created reservations ['02f57db9-b6c9-4dce-91d0-338d9e868647', '43bd4bdb-a620-4c17-9034-7bd25c87ef81', '71c8b0c9-2d90-4a6b-bb82-fd8502e17a27', 'a4773f36-1afd-44c0-a729-b75c722e625e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:09 devstack cinder-volume[87385]: WARNING cinder.quota [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1428036568 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1428036568, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:09 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" returned: 0 in 2.640s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_gsrhl4b_devstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:33:09 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Converted 112.00 MB image at 42.41 MB/s Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['678f0cf6-b255-4b8d-be87-9feb6820ed68', 'eb97afbe-b74d-437d-8f03-ecb8daad42df', '20dbd8ce-6e50-4755-a33c-1f62f0dea34c', '1fed684b-5c5a-4684-815e-1dd031e77302'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:09 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1G Jul 28 14:33:09 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:09 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:09 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9cb46e10-6f8a-41eb-9d07-776339bfed23 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 6e9c4210-be28-4e43-a2a9-2fe86bb18b39: deleted successfully Jul 28 14:33:09 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.380s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Deleted volume successfully. Jul 28 14:33:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ace91792-0f5f-467d-bd52-27a771a8f98a tempest-ProjectReaderTests-55820395 None] Lock "cinder-e2b73531-a901-4106-b042-1d823917ed21-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:10 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 1G" returned: 0 in 0.577s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Downloaded image b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0 successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f for user 6a1baaf190604b0e9d5373ccff7f7105 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Marking volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0 as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Copying metadata from image b313c492-604e-4cdd-96f9-0cabb9f2068f to a5de24e3-c59a-46e7-9c15-d8e99a5881d0. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Creating volume glance metadata for volume a5de24e3-c59a-46e7-9c15-d8e99a5881d0 backed by image b313c492-604e-4cdd-96f9-0cabb9f2068f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf83d3-0e0e-4d93-bf72-c8f9f71cffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8de9e12-ce4a-4fb1-9b08-fb0a10081e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Volume volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 (a5de24e3-c59a-46e7-9c15-d8e99a5881d0): created successfully Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8de9e12-ce4a-4fb1-9b08-fb0a10081e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Flow 'volume_create_manager' (4aea9c07-6118-4295-aa30-bea5cad6d1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-fc57097f-449d-4b5c-895e-efe704a9317b tempest-VolumesExtendTest-1557883235 None] Created volume successfully. Jul 28 14:33:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[faec0c08-23e2-442c-986c-d9c6acce11fc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:11 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:33:11 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[db328ea0-b9d2-45e1-8669-097382475c93]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Flow 'volume_create_manager' (5e822b24-622c-46e5-9ac1-bb299f0def94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aa306d-836b-492c-b0b0-059a57680c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:11 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 Jul 28 14:33:11 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aa306d-836b-492c-b0b0-059a57680c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197984682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54de359b-e18b-4ed8-b31e-cc12d624d668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8df3bd804af45ed9c7c25ee36a6b848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:11Z,use_quota=True,user_id='a59caf255a954149961999a044deb4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9195a3-17ba-41f3-94f0-d7a406075163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9195a3-17ba-41f3-94f0-d7a406075163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2ecfba-8288-4f2b-9d67-0ef604209507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2ecfba-8288-4f2b-9d67-0ef604209507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54de359b-e18b-4ed8-b31e-cc12d624d668', 'volume_name': 'volume-54de359b-e18b-4ed8-b31e-cc12d624d668', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70d93aa-e814-48ca-a115-fd9dc3fdbe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70d93aa-e814-48ca-a115-fd9dc3fdbe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff7c67e-e49f-4e20-be15-9d7ce09f8dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:11 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Volume 54de359b-e18b-4ed8-b31e-cc12d624d668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54de359b-e18b-4ed8-b31e-cc12d624d668', 'volume_size': 1} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:11 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.569s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:11 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7 Jul 28 14:33:11 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:11 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" returned: 0 in 0.456s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 2G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:11 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-94256a01-6afb-48e3-9c23-c756a4ae0cf7" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-94256a01-6afb-48e3-9c23-c756a4ae0cf7" released by "delete_volume" :: held 0.945s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 2G" returned: 0 in 0.160s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.649s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197984682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54de359b-e18b-4ed8-b31e-cc12d624d668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8df3bd804af45ed9c7c25ee36a6b848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:11Z,use_quota=True,user_id='a59caf255a954149961999a044deb4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Creating volume 54de359b-e18b-4ed8-b31e-cc12d624d668 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:12 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:12 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 1073741824 Jul 28 14:33:12 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['92b7044b-d03a-43a5-b4e0-724282d8ffa0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-138ac657-a439-4005-8559-15e0a244aeb7 tempest-VolumesExtendTest-1557883235 None] Extend volume completed successfully. Jul 28 14:33:12 devstack cinder-volume[87385]: WARNING cinder.db.api [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1428036568'] Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['f0575aab-ccd8-48ff-8e62-1cd06b721419', '86059cd2-2355-421c-9df2-a0e1655764a9', '45dbcebf-b325-47c2-b537-29600c67b0e9', '82ca7d55-68ef-4638-90bc-a3e591e7db32'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:12 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:12 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-a5de24e3-c59a-46e7-9c15-d8e99a5881d0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-a5de24e3-c59a-46e7-9c15-d8e99a5881d0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:12 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 1073741824" returned: 0 in 0.747s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:12 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-quobyte-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.522s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e64503ba-4192-4b40-b16a-1d6ff92a3b67 tempest-GroupSnapshotsTest-1530526815 None] Delete group completed successfully. Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" acquired by "delete_volume" :: waited 0.038s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963a62f-bd8b-4cdd-b7d0-e5c185521a7f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:12 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 Jul 28 14:33:12 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:13 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 Jul 28 14:33:13 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-699db9e0-0bba-4f07-ac52-cafda6f0ca20 tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-1298863130: creating Jul 28 14:33:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-699db9e0-0bba-4f07-ac52-cafda6f0ca20 tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-1298863130: created successfully Jul 28 14:33:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-699db9e0-0bba-4f07-ac52-cafda6f0ca20 tempest-GroupSnapshotsTest-1530526815 None] Create group completed successfully. Jul 28 14:33:13 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668" returned: 0 in 0.575s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff7c67e-e49f-4e20-be15-9d7ce09f8dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54de359b-e18b-4ed8-b31e-cc12d624d668', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4250a9-dfeb-4e9b-8fe9-39f5f62da3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Volume volume-54de359b-e18b-4ed8-b31e-cc12d624d668 (54de359b-e18b-4ed8-b31e-cc12d624d668): created successfully Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4250a9-dfeb-4e9b-8fe9-39f5f62da3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Flow 'volume_create_manager' (5e822b24-622c-46e5-9ac1-bb299f0def94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-894caa5f-7758-4f29-a499-4afd5e2ace37 tempest-ProjectReaderTests-55820395 None] Created volume successfully. Jul 28 14:33:13 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" returned: 0 in 0.696s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:13 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0 Jul 28 14:33:13 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:13 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-a5de24e3-c59a-46e7-9c15-d8e99a5881d0" released by "delete_volume" :: held 1.024s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:13 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Created reservations ['d79fa91c-b278-4b25-8853-98d70d8dcf7d', '4016deae-c6f3-4316-88b1-e856404ce644', 'e72b7db0-aeea-494a-af2f-4dee55df7b78', '6702d28b-b6e4-4dec-a12e-063d729cbfac'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:14 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:14 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:14 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:14 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Deleted volume successfully. Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-945c6434-53db-4261-98df-3c931cfc72d9 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-a5de24e3-c59a-46e7-9c15-d8e99a5881d0-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Acquiring lock "cinder-54de359b-e18b-4ed8-b31e-cc12d624d668-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "cinder-54de359b-e18b-4ed8-b31e-cc12d624d668-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Acquiring lock "cinder-quobyte-54de359b-e18b-4ed8-b31e-cc12d624d668" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "cinder-quobyte-54de359b-e18b-4ed8-b31e-cc12d624d668" acquired by "delete_volume" :: waited 0.056s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f6a45-7a85-4940-a9a2-5ac08d028210]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (9739a06d-78fe-46ca-96ee-37ae20ed76a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482c9846-8b8a-4d6c-a026-5be9fabb1843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482c9846-8b8a-4d6c-a026-5be9fabb1843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683057503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec75597-358f-4eef-a966-70ac84421558,host='devstack@QuobyteHD#QuobyteHD',id=fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:15Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c),volume_type_id=7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53dd38c9-cb7f-4305-8f6f-67bcd33721da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53dd38c9-cb7f-4305-8f6f-67bcd33721da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4d1f8d-d90d-4cd1-b3d6-1f936a78afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4d1f8d-d90d-4cd1-b3d6-1f936a78afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f', 'volume_name': 'volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75c738-f224-4be4-8ca2-35b75f0585a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75c738-f224-4be4-8ca2-35b75f0585a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8d9f9-57cd-47b2-9d15-52abd9171009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:15 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Volume fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f', 'volume_size': 1} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cec75597-358f-4eef-a966-70ac84421558,created_at=2026-07-28T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683057503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec75597-358f-4eef-a966-70ac84421558,host='devstack@QuobyteHD#QuobyteHD',id=fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:15Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c),volume_type_id=7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Creating volume fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:15 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:15 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 Jul 28 14:33:15 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:15 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f 1073741824 Jul 28 14:33:15 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:15 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668" returned: 0 in 0.788s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:15 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668 Jul 28 14:33:15 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:15 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f 1073741824" returned: 0 in 0.599s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:15 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Flow 'volume_create_manager' (cc60f6aa-085e-4d6e-befd-5ef759a7abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a12015-1f71-4873-9f69-cbc226c6839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a12015-1f71-4873-9f69-cbc226c6839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2105679484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de1fdd-cfc6-4312-ab15-cc4311e1e648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8a6213e854c12831827f3a5d46e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:16Z,use_quota=True,user_id='6a1baaf190604b0e9d5373ccff7f7105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64f6bb0-a49d-42ce-a9c6-206dfda0cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64f6bb0-a49d-42ce-a9c6-206dfda0cad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eafbd71-6daf-4335-a897-28896771979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eafbd71-6daf-4335-a897-28896771979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8de1fdd-cfc6-4312-ab15-cc4311e1e648', 'volume_name': 'volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2556f-5891-4bc0-b0a2-c3206d0669d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed2556f-5891-4bc0-b0a2-c3206d0669d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eade4b8a-86e2-4425-a3b4-c6e0a1e147af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Volume e8de1fdd-cfc6-4312-ab15-cc4311e1e648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648', 'volume_size': 1} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:16 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-54de359b-e18b-4ed8-b31e-cc12d624d668" returned: 0 in 0.437s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "cinder-quobyte-54de359b-e18b-4ed8-b31e-cc12d624d668" released by "delete_volume" :: held 1.327s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Created reservations ['239f36ec-3a16-492e-bba2-4a3d4b06797f', '4c70a201-758d-4fb2-b788-00f8efedd97e', '9f6016f2-dd52-4791-a66e-429528be2094', '2048ef33-eede-4c8b-80ec-fd5efc83cdad'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:16 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2105679484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de1fdd-cfc6-4312-ab15-cc4311e1e648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8a6213e854c12831827f3a5d46e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:16Z,use_quota=True,user_id='6a1baaf190604b0e9d5373ccff7f7105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Creating volume e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:16 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c8d9f9-57cd-47b2-9d15-52abd9171009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b5bb2-4541-4a13-8f28-ebb5f6ef7838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:16 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 1073741824 Jul 28 14:33:16 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:16 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Volume volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f (fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f): created successfully Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b5bb2-4541-4a13-8f28-ebb5f6ef7838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (9739a06d-78fe-46ca-96ee-37ae20ed76a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b2c00fd0-4572-4d72-9c68-611d9a8747ed tempest-GroupSnapshotsTest-1530526815 None] Created volume successfully. Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:16 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:16 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:16 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Deleted volume successfully. Jul 28 14:33:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ad48cbcf-00eb-4e3c-966e-ec27dcc50102 tempest-ProjectReaderTests-55820395 None] Lock "cinder-54de359b-e18b-4ed8-b31e-cc12d624d668-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:17 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 1073741824" returned: 0 in 0.741s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:17 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:17 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:17 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.319s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eade4b8a-86e2-4425-a3b4-c6e0a1e147af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ad18cb-1d63-4e52-8526-b5f090e8f21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:17 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Volume volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 (e8de1fdd-cfc6-4312-ab15-cc4311e1e648): created successfully Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ad18cb-1d63-4e52-8526-b5f090e8f21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Flow 'volume_create_manager' (cc60f6aa-085e-4d6e-befd-5ef759a7abb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ffffcbbb-b5f0-492c-9d7d-49b69645e1f8 tempest-VolumesExtendTest-1557883235 None] Created volume successfully. Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Creating offline snapshot 5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d of volume e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9414179-47b6-4c2c-9cb1-743681e95be5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:18 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:18 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:18 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.603s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:18 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d 1G Jul 28 14:33:18 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (9e21c8b0-fb56-47ff-941d-8a248b288bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eead6b-dd79-467a-84f3-9c0ec1d2932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60eead6b-dd79-467a-84f3-9c0ec1d2932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105384004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec75597-358f-4eef-a966-70ac84421558,host='devstack@QuobyteHD#QuobyteHD',id=d81a69f0-858c-4f43-b588-92f6609f9924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:19Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c),volume_type_id=7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481f58e7-4670-4b01-9e56-d43789a5926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481f58e7-4670-4b01-9e56-d43789a5926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c5ff84-c5a3-4010-ab5c-40599491b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c5ff84-c5a3-4010-ab5c-40599491b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81a69f0-858c-4f43-b588-92f6609f9924', 'volume_name': 'volume-d81a69f0-858c-4f43-b588-92f6609f9924', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4610975c-9f00-4453-b7ca-2de8b09cce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4610975c-9f00-4453-b7ca-2de8b09cce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc40aca-93c3-4d27-bd74-067fbb9d1848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Volume d81a69f0-858c-4f43-b588-92f6609f9924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81a69f0-858c-4f43-b588-92f6609f9924', 'volume_size': 1} Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:19 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d 1G" returned: 0 in 0.501s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:19 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d Jul 28 14:33:19 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:19 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:19 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d is being set with open permissions: ugo+rw Jul 28 14:33:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:19 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d Jul 28 14:33:19 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:20 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:20 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info Jul 28 14:33:20 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:20 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info" returned: 0 in 0.283s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:20 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info is being set with open permissions: ugo+rw Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:20 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info Jul 28 14:33:20 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:20 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.info" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cec75597-358f-4eef-a966-70ac84421558,created_at=2026-07-28T12:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-105384004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec75597-358f-4eef-a966-70ac84421558,host='devstack@QuobyteHD#QuobyteHD',id=d81a69f0-858c-4f43-b588-92f6609f9924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:19Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c),volume_type_id=7cf805ea-3188-42ba-9dbf-bd4c1c75bb3c)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Creating volume d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:20 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 1073741824 Jul 28 14:33:20 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f0066309-5f38-4e04-b29b-a69a627c36d0 tempest-VolumesExtendTest-1557883235 None] Create snapshot completed successfully Jul 28 14:33:21 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 1073741824" returned: 0 in 0.469s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:21 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 Jul 28 14:33:21 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:21 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924" returned: 0 in 0.411s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.085s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc40aca-93c3-4d27-bd74-067fbb9d1848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81a69f0-858c-4f43-b588-92f6609f9924', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f497c4-3213-4c84-81a0-ecb5ec7cdf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d9f86-ed9b-4e35-b8cd-7b03ec2c8042]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Volume volume-d81a69f0-858c-4f43-b588-92f6609f9924 (d81a69f0-858c-4f43-b588-92f6609f9924): created successfully Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f497c4-3213-4c84-81a0-ecb5ec7cdf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (9e21c8b0-fb56-47ff-941d-8a248b288bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-699137ce-c83d-47b1-acda-1d2532af1796 tempest-GroupSnapshotsTest-1530526815 None] Created volume successfully. Jul 28 14:33:21 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:21 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:22 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d 2G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d 2G" returned: 0 in 0.149s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.621s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ebf0b71a-3a6e-48f8-9d80-5e7c103fb77f tempest-VolumesExtendTest-1557883235 None] Extend volume completed successfully. Jul 28 14:33:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-667697a1-f3c2-497f-8ede-8059852a7142 tempest-GroupSnapshotsTest-1530526815 None] Update group completed successfully. Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-quobyte-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Deleting offline snapshot 5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d of volume e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] snapshot_file for this snap is: volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923cdbd-efc2-4b64-b89a-4357c402207b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:22 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d Jul 28 14:33:22 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:23 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" returned: 0 in 0.433s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487f1eb-bdca-4a8e-933e-ebe59e7cf3aa]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:23 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:23 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:23 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.514s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-84e6496c-261b-4881-ac5c-3de47ac7e3cc tempest-GroupSnapshotsTest-1530526815 None] Update group completed successfully. Jul 28 14:33:23 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d Jul 28 14:33:23 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:24 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" returned: 0 in 0.434s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:24 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d Jul 28 14:33:24 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:24 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648.5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d" released by "_delete_snapshot" :: held 1.792s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" released by "delete_snapshot" :: held 1.825s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Created reservations ['bec52238-dd69-4857-b5e3-4a4cf9d255ed', 'b254f301-aeab-43cb-a20e-365eda3180a3', '4cfc4e42-f734-45c9-86d8-9a8923abde40', 'a1c37ea9-2cda-47de-b91f-cf51ee22bdc9'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Delete snapshot completed successfully. Jul 28 14:33:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ae6e817-4ea4-4e13-91da-1341bafbe05e tempest-VolumesExtendTest-1557883235 None] Lock "cinder-5d0f0d48-8803-4fa2-9a91-5b5415fa5d9d-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-08f348d4-f3d6-4bb7-83a8-d121a15aff46 tempest-GroupSnapshotsTest-1530526815 None] Update group completed successfully. Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-e8de1fdd-cfc6-4312-ab15-cc4311e1e648-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-e8de1fdd-cfc6-4312-ab15-cc4311e1e648-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a7df29-38b0-475a-815e-353c605d7561]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:25 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:25 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:25 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.389s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:25 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648 Jul 28 14:33:25 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:25 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-quobyte-e8de1fdd-cfc6-4312-ab15-cc4311e1e648" released by "delete_volume" :: held 0.720s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Created reservations ['ee102d20-421c-4b6c-928c-0c3c8279e4b6', '9ec4c61d-8673-499e-9350-f1b14ef06685', 'acbbca3d-c811-414b-8750-73e2bd5e3641', '8b92fec0-e11e-496c-9cf4-dc9505bcc6ef'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:26 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:26 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1264dc80-017f-4195-8946-408e361b36c8 tempest-GroupSnapshotsTest-1530526815 None] Update group completed successfully. Jul 28 14:33:26 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Deleted volume successfully. Jul 28 14:33:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ee60539-a36f-4e3a-8878-832102158293 tempest-VolumesExtendTest-1557883235 None] Lock "cinder-e8de1fdd-cfc6-4312-ab15-cc4311e1e648-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (5e447f81-1df3-44b5-8ad9-d04f378e1ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650a0109-8a9f-436c-ab33-aaec9b053c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650a0109-8a9f-436c-ab33-aaec9b053c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796871960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6906fdd8-83a5-42c8-94c1-a4709757e3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:27Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5515cd-f138-465b-b85d-0804cfa3c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5515cd-f138-465b-b85d-0804cfa3c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e4d64-e31f-4edb-821f-cf6982f73a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e4d64-e31f-4edb-821f-cf6982f73a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6906fdd8-83a5-42c8-94c1-a4709757e3e5', 'volume_name': 'volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a668164-2880-4ac9-909d-c6abecf94e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a668164-2880-4ac9-909d-c6abecf94e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73198fe1-54df-48cc-b997-aa3c2ae4092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Volume 6906fdd8-83a5-42c8-94c1-a4709757e3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5', 'volume_size': 1} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796871960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6906fdd8-83a5-42c8-94c1-a4709757e3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:27Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Creating volume 6906fdd8-83a5-42c8-94c1-a4709757e3e5 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:27 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:27 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 1073741824 Jul 28 14:33:27 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] GroupSnapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: creating. Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Group snapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: creating. {{(pid=87385) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 14:33:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:28 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 1073741824" returned: 0 in 0.495s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:28 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 Jul 28 14:33:28 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:28 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.458s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73198fe1-54df-48cc-b997-aa3c2ae4092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d8df6-b0b4-4a8c-b629-cd3297ed76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Creating offline snapshot 81e50cad-9a60-4ac3-8e4e-d2c7706a8055 of volume d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:33:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Volume volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 (6906fdd8-83a5-42c8-94c1-a4709757e3e5): created successfully Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861d8df6-b0b4-4a8c-b629-cd3297ed76b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (5e447f81-1df3-44b5-8ad9-d04f378e1ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b7ee9-6ce1-41c7-96dc-92bbfc9f7dca]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-41f4923b-3841-48db-93ba-9cfbb01b19f9 tempest-ProjectReaderTests-1819653783 None] Created volume successfully. Jul 28 14:33:28 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 Jul 28 14:33:28 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:28 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924" returned: 0 in 0.385s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:28 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 1G Jul 28 14:33:28 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:29 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 1G" returned: 0 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81a69f0-858c-4f43-b588-92f6609f9924 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:29 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81a69f0-858c-4f43-b588-92f6609f9924 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 Jul 28 14:33:29 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (08ce8a3d-33b2-4a6c-934d-cadfbd17f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309a4230-a6d5-49f7-b917-d4b4322fea84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309a4230-a6d5-49f7-b917-d4b4322fea84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1611564828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bde3a30-2fed-48e7-ba2d-973ea6f9d417,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:29Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caede36c-1c6a-4da3-a0ad-9c16f8761d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caede36c-1c6a-4da3-a0ad-9c16f8761d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c8a55e-4144-467f-8414-b694c364f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c8a55e-4144-467f-8414-b694c364f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bde3a30-2fed-48e7-ba2d-973ea6f9d417', 'volume_name': 'volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2694b861-2a3a-44d2-8576-ec36ab17e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2694b861-2a3a-44d2-8576-ec36ab17e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fa340e-2c09-4410-a500-4bd16c7a6553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Volume 5bde3a30-2fed-48e7-ba2d-973ea6f9d417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417', 'volume_size': 1} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:29 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81a69f0-858c-4f43-b588-92f6609f9924 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:29 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:29 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 Jul 28 14:33:29 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-6906fdd8-83a5-42c8-94c1-a4709757e3e5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-6906fdd8-83a5-42c8-94c1-a4709757e3e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-quobyte-6906fdd8-83a5-42c8-94c1-a4709757e3e5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-6906fdd8-83a5-42c8-94c1-a4709757e3e5" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfca45e-7cd7-4a6a-8c7b-6e54836e854e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:29 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:29 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info Jul 28 14:33:29 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:29 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 Jul 28 14:33:29 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:30 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info Jul 28 14:33:30 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:30 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5 Jul 28 14:33:30 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.info" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Creating offline snapshot dbd5758c-a7d9-40eb-bbc4-bfa2b377601d of volume fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f94a29-3219-42d7-afd5-5f6237f99f20]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:30 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6906fdd8-83a5-42c8-94c1-a4709757e3e5" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-6906fdd8-83a5-42c8-94c1-a4709757e3e5" released by "delete_volume" :: held 0.746s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Created reservations ['f063d0dd-e672-4edc-8c16-36ea05775b9d', '957c96cb-e1b9-4e3f-846a-ef020e06caf3', 'ebfef3f3-6d47-4047-ace3-b0475216d2df', 'a0e905fe-58b1-4817-b8e4-a6caa34c84f8'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:30 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f Jul 28 14:33:30 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:30 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:30 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:30 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d 1G Jul 28 14:33:30 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:30 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Deleted volume successfully. Jul 28 14:33:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1f5873d9-0b33-4093-9dc1-4a321256f026 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-6906fdd8-83a5-42c8-94c1-a4709757e3e5-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:31 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d 1G" returned: 0 in 0.475s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:31 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d Jul 28 14:33:31 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (6f61d231-7cef-4554-b4c0-cda3def18674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3dda2d-5b87-48ed-9b45-328c90d66b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3dda2d-5b87-48ed-9b45-328c90d66b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615348554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e60288-d4f6-41b6-8dbf-011687538c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:31Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441f2930-db5c-4cec-a409-f02f1a5363d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441f2930-db5c-4cec-a409-f02f1a5363d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bfc1f3-2813-475f-8ba1-ea37a45c00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bfc1f3-2813-475f-8ba1-ea37a45c00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e60288-d4f6-41b6-8dbf-011687538c22', 'volume_name': 'volume-84e60288-d4f6-41b6-8dbf-011687538c22', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577e4b9c-1abe-4232-adf3-991e8b40a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577e4b9c-1abe-4232-adf3-991e8b40a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795fd99f-c0f1-47d0-888c-583719b0f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Volume 84e60288-d4f6-41b6-8dbf-011687538c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e60288-d4f6-41b6-8dbf-011687538c22', 'volume_size': 1} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:31 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:31 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:31 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d Jul 28 14:33:31 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:31 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:31 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info Jul 28 14:33:31 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:32 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info" returned: 0 in 0.275s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:32 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:32 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info Jul 28 14:33:32 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:32 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.info" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1611564828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bde3a30-2fed-48e7-ba2d-973ea6f9d417,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:29Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Creating volume 5bde3a30-2fed-48e7-ba2d-973ea6f9d417 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:32 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:32 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 1073741824 Jul 28 14:33:32 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-44732063-73db-4c88-bbcf-e69426f61bcf tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: created successfully Jul 28 14:33:32 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 1073741824" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:32 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 Jul 28 14:33:32 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:33 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" returned: 0 in 0.247s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615348554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e60288-d4f6-41b6-8dbf-011687538c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:31Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Creating volume 84e60288-d4f6-41b6-8dbf-011687538c22 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:33 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fa340e-2c09-4410-a500-4bd16c7a6553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:33 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 1073741824 Jul 28 14:33:33 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1a38b2-1f6d-4f14-aca9-feea30008423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Volume volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 (5bde3a30-2fed-48e7-ba2d-973ea6f9d417): created successfully Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1a38b2-1f6d-4f14-aca9-feea30008423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (08ce8a3d-33b2-4a6c-934d-cadfbd17f045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a8b2008c-9328-48b1-9b02-13f671a2190d tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:33:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: deleting Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: deleting {{(pid=87385) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-81e50cad-9a60-4ac3-8e4e-d2c7706a8055" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-81e50cad-9a60-4ac3-8e4e-d2c7706a8055" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Deleting offline snapshot 81e50cad-9a60-4ac3-8e4e-d2c7706a8055 of volume d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] snapshot_file for this snap is: volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b0fe7-b996-4431-a75a-231cb18572f5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:33 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 Jul 28 14:33:33 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:33 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 1073741824" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:33 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 Jul 28 14:33:33 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:33 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81a69f0-858c-4f43-b588-92f6609f9924(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a78e58-0e7c-4c07-8f54-4fa0df97900d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:33 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 Jul 28 14:33:33 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:33 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795fd99f-c0f1-47d0-888c-583719b0f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e60288-d4f6-41b6-8dbf-011687538c22', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c00315-1f5a-4205-a5db-87efb1a215b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Volume volume-84e60288-d4f6-41b6-8dbf-011687538c22 (84e60288-d4f6-41b6-8dbf-011687538c22): created successfully Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c00315-1f5a-4205-a5db-87efb1a215b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (6f61d231-7cef-4554-b4c0-cda3def18674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-620a0eb7-259f-4873-ac7a-2bc06ed07c36 tempest-ProjectReaderTests-1819653783 None] Created volume successfully. Jul 28 14:33:34 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:34 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 Jul 28 14:33:34 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (a208e987-5627-4260-93ef-c7cd1e461cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b211f7a-4215-4fda-9e32-a6e6ea9f26b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b211f7a-4215-4fda-9e32-a6e6ea9f26b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-428959679',display_name='tempest-VolumesGetTest-Volume-379463560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb64cc85-c4b1-4b14-bddb-254275ea9fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:34Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865c1860-4ac5-4d07-b1ce-ae55d70c6c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865c1860-4ac5-4d07-b1ce-ae55d70c6c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393c092-78a9-4b76-bcdd-feffebd2054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f393c092-78a9-4b76-bcdd-feffebd2054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb64cc85-c4b1-4b14-bddb-254275ea9fb9', 'volume_name': 'volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb55a2bf-ab1c-4192-bd5f-354f1fbf5996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb55a2bf-ab1c-4192-bd5f-354f1fbf5996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a41ece1-abe2-44be-91a8-ab506cd55ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:34 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Volume bb64cc85-c4b1-4b14-bddb-254275ea9fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9', 'volume_size': 1} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-428959679',display_name='tempest-VolumesGetTest-Volume-379463560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb64cc85-c4b1-4b14-bddb-254275ea9fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:34Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Creating volume bb64cc85-c4b1-4b14-bddb-254275ea9fb9 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:34 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:34 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 1073741824 Jul 28 14:33:34 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-84e60288-d4f6-41b6-8dbf-011687538c22-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:34 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-84e60288-d4f6-41b6-8dbf-011687538c22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:34 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055 Jul 28 14:33:34 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-quobyte-84e60288-d4f6-41b6-8dbf-011687538c22" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-84e60288-d4f6-41b6-8dbf-011687538c22" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5318e5c7-a283-4a20-849c-416b7e263658]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:34 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 Jul 28 14:33:34 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:34 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:34 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924.81e50cad-9a60-4ac3-8e4e-d2c7706a8055" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 1073741824" returned: 0 in 0.522s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-81e50cad-9a60-4ac3-8e4e-d2c7706a8055" released by "_delete_snapshot" :: held 1.590s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" released by "delete_snapshot" :: held 1.620s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:35 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 Jul 28 14:33:35 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Deleting offline snapshot dbd5758c-a7d9-40eb-bbc4-bfa2b377601d of volume fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] snapshot_file for this snap is: volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6577d00-3d64-4803-90ab-21ca46b02bd8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d Jul 28 14:33:35 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22 Jul 28 14:33:35 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a41ece1-abe2-44be-91a8-ab506cd55ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d0620e-6e2f-4611-818c-00b52f2736a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:35 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Volume volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 (bb64cc85-c4b1-4b14-bddb-254275ea9fb9): created successfully Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d0620e-6e2f-4611-818c-00b52f2736a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (a208e987-5627-4260-93ef-c7cd1e461cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2a730623-9dec-4b55-902c-050bdf703f38 tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:33:35 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84e60288-d4f6-41b6-8dbf-011687538c22" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-84e60288-d4f6-41b6-8dbf-011687538c22" released by "delete_volume" :: held 0.741s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc60323-713b-45fb-8887-07335763aec9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Created reservations ['ca3a0b65-54f4-4c3c-a59d-1efab83057f3', 'b20cb754-703c-4172-bd86-df089f51c177', 'bcbde857-a5e1-4f7a-9863-8d7fec2be467', '483d364d-280b-4290-82e6-fe8a0bbbffcf'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:35 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:35 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:35 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Deleted volume successfully. Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" returned: 0 in 0.382s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:35 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d Jul 28 14:33:35 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90c8daa0-c19d-474e-8e88-2c0c79a35b70 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-84e60288-d4f6-41b6-8dbf-011687538c22-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:36 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" returned: 0 in 0.358s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:36 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d Jul 28 14:33:36 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (76942323-ed52-434b-961a-7693bf8f35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d3d48d-68ec-4e47-80b6-fc4b128073f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d3d48d-68ec-4e47-80b6-fc4b128073f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651567912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9efa66-8364-40a0-b5b7-5b272efffb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:36Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6505cffe-719c-4eab-abc3-d69287753a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6505cffe-719c-4eab-abc3-d69287753a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d84bb09-5f83-4c63-bce0-8a97d74d19ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d84bb09-5f83-4c63-bce0-8a97d74d19ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9efa66-8364-40a0-b5b7-5b272efffb70', 'volume_name': 'volume-9a9efa66-8364-40a0-b5b7-5b272efffb70', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a5a621-9133-4262-b56b-d9772440b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a5a621-9133-4262-b56b-d9772440b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa39ed9a-6468-48ac-8017-e6917257f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:36 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Volume 9a9efa66-8364-40a0-b5b7-5b272efffb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9efa66-8364-40a0-b5b7-5b272efffb70', 'volume_size': 1} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651567912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9efa66-8364-40a0-b5b7-5b272efffb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:36Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Creating volume 9a9efa66-8364-40a0-b5b7-5b272efffb70 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:36 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:36 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 1073741824 Jul 28 14:33:36 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:36 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f.dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-dbd5758c-a7d9-40eb-bbc4-bfa2b377601d" released by "_delete_snapshot" :: held 1.510s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" released by "delete_snapshot" :: held 1.531s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-bb64cc85-c4b1-4b14-bddb-254275ea9fb9-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "cinder-bb64cc85-c4b1-4b14-bddb-254275ea9fb9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-445434938 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-445434938, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-445434938 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-445434938, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f3daa-14f9-442f-aa0b-7e2cff24cb89]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['6b88effa-bb70-405b-927b-207b963528cb', '64e9fecc-d53a-4639-9bee-de5bd8a0e1c3', '5a0bf3d1-dda9-461e-8e91-676c3c682006', 'd401c06b-fae1-4584-b58d-7879d1053382'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['75740813-4a63-4750-a6e7-868e524f9497', '2255cd53-2dc9-4eed-9b0a-7cba9bcdc58f', 'ca5aeeff-1904-43dc-a3d1-a275ce9e47f7', '8bceb5c6-c672-4700-9e25-86075b4242ce'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:36 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 Jul 28 14:33:36 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-913fe5d4-e73e-43c1-b399-6883a6b6cda2 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 3368f842-f64d-4ec4-94ec-0a3a5dea6365: deleted successfully Jul 28 14:33:36 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 1073741824" returned: 0 in 0.590s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:37 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 Jul 28 14:33:37 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:37 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" returned: 0 in 0.509s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:37 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9 Jul 28 14:33:37 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:37 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70" returned: 0 in 0.297s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa39ed9a-6468-48ac-8017-e6917257f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9efa66-8364-40a0-b5b7-5b272efffb70', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3d8d4-f626-4a78-9255-d8f5c8b1500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (da888878-267f-4ff9-8456-9fa08b168b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d3bce3-c274-449c-9029-cd0c00818103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d3bce3-c274-449c-9029-cd0c00818103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1857218532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2294b7-4f00-442c-bec0-e469aa363a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:37Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91bad51-20c2-481f-819b-e871fe0306ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91bad51-20c2-481f-819b-e871fe0306ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32279f1-5d5a-4f6c-bd95-b58abb4040f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32279f1-5d5a-4f6c-bd95-b58abb4040f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2294b7-4f00-442c-bec0-e469aa363a9e', 'volume_name': 'volume-fa2294b7-4f00-442c-bec0-e469aa363a9e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d95c0-a3ad-4da3-86de-2611f96cc047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d95c0-a3ad-4da3-86de-2611f96cc047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe71a7-bd44-4bc6-8f99-4b826a3e5649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:37 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Volume fa2294b7-4f00-442c-bec0-e469aa363a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2294b7-4f00-442c-bec0-e469aa363a9e', 'volume_size': 1} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1857218532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2294b7-4f00-442c-bec0-e469aa363a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:37Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Creating volume fa2294b7-4f00-442c-bec0-e469aa363a9e {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:37 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:37 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Volume volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 (9a9efa66-8364-40a0-b5b7-5b272efffb70): created successfully Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e3d8d4-f626-4a78-9255-d8f5c8b1500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (76942323-ed52-434b-961a-7693bf8f35c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:37 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e 1073741824 Jul 28 14:33:37 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ff408496-3a35-47da-84db-ae187b552eef tempest-ProjectReaderTests-1819653783 None] Created volume successfully. Jul 28 14:33:37 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-bb64cc85-c4b1-4b14-bddb-254275ea9fb9" released by "delete_volume" :: held 0.822s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Created reservations ['89f55936-6a73-4772-a8fd-7f4bf99f928f', '4c4e2ec4-2607-4208-aed5-3707586192e6', '02796af3-43d5-493c-ad4e-35f9fcac1dcc', 'ed96d9dd-19a4-4abc-8904-e209a0f00f7f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:37 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:37 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-5bde3a30-2fed-48e7-ba2d-973ea6f9d417-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "cinder-5bde3a30-2fed-48e7-ba2d-973ea6f9d417-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:37 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb1a77-7e8b-461a-b67b-6b9b8944e05c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:37 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e 1073741824" returned: 0 in 0.566s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.321s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e85c886-207b-4e96-8224-396747d6363c tempest-VolumesGetTest-934453715 None] Lock "cinder-bb64cc85-c4b1-4b14-bddb-254275ea9fb9-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e Jul 28 14:33:38 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 Jul 28 14:33:38 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e" returned: 0 in 0.293s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe71a7-bd44-4bc6-8f99-4b826a3e5649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2294b7-4f00-442c-bec0-e469aa363a9e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c5cc6-7b83-4b53-b5a2-a016e922a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Volume volume-fa2294b7-4f00-442c-bec0-e469aa363a9e (fa2294b7-4f00-442c-bec0-e469aa363a9e): created successfully Jul 28 14:33:38 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5c5cc6-7b83-4b53-b5a2-a016e922a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (da888878-267f-4ff9-8456-9fa08b168b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" returned: 0 in 0.436s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-695bcd1b-fbeb-42ee-a5df-f471f3f4312d tempest-AttachVolumeTestJSON-668992739 None] Created volume successfully. Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" acquired by "delete_volume" :: waited 0.067s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:38 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417 Jul 28 14:33:38 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-9a9efa66-8364-40a0-b5b7-5b272efffb70-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89c2aba-9cc3-4c85-89c0-2025120a39e9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-9a9efa66-8364-40a0-b5b7-5b272efffb70-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-quobyte-9a9efa66-8364-40a0-b5b7-5b272efffb70" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-9a9efa66-8364-40a0-b5b7-5b272efffb70" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6419c46-6eea-4554-a58a-b48c5673f4e7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 Jul 28 14:33:38 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-5bde3a30-2fed-48e7-ba2d-973ea6f9d417" released by "delete_volume" :: held 0.782s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:38 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 Jul 28 14:33:38 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Created reservations ['62c11899-7b51-4d80-bb9e-fa7c5755ecd8', '168fac65-9ed9-47d9-8096-6dd02373fb41', 'ef067137-891a-4237-a836-5604091344ee', 'bf1fbbd2-a820-4e39-adcb-69be0af59d1e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:38 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:38 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:38 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924 Jul 28 14:33:38 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:39 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70 Jul 28 14:33:39 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.276s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-252727a4-3d92-496b-bfe2-12edb88aeb0e tempest-VolumesGetTest-934453715 None] Lock "cinder-5bde3a30-2fed-48e7-ba2d-973ea6f9d417-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:39 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d81a69f0-858c-4f43-b588-92f6609f9924" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-d81a69f0-858c-4f43-b588-92f6609f9924" released by "delete_volume" :: held 0.805s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93bb18a-ea82-4b5d-90b2-38245659beb5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:39 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9a9efa66-8364-40a0-b5b7-5b272efffb70" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-9a9efa66-8364-40a0-b5b7-5b272efffb70" released by "delete_volume" :: held 0.798s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Created reservations ['219a84bd-1532-4dbd-8fa1-20ebfcd465df', '6b6750b7-d6bb-4c7d-a481-05418e23e353', '3a20967a-2e55-46cb-8228-003b1c1e226c', 'e0e7c002-89ea-4551-8b83-76cd1417a8a6'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:39 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f Jul 28 14:33:39 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:39 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:39 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (fea3ddf8-6102-4b35-9066-4b6bf287c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffbf120-8a19-435b-baa5-c4fe35b4d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffbf120-8a19-435b-baa5-c4fe35b4d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859837649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197f738b-0210-40a5-b1fc-fbec110cc573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:39Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43abb232-fa90-4684-bd54-a84bc2b59237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43abb232-fa90-4684-bd54-a84bc2b59237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:39 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ca8267-0670-4db6-ab1a-1da89d8c490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ca8267-0670-4db6-ab1a-1da89d8c490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197f738b-0210-40a5-b1fc-fbec110cc573', 'volume_name': 'volume-197f738b-0210-40a5-b1fc-fbec110cc573', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e849d2-94c2-471d-9185-0b7612f59aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e849d2-94c2-471d-9185-0b7612f59aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751bebdd-8ec5-4606-b090-5d3de19dfbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:39 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Volume 197f738b-0210-40a5-b1fc-fbec110cc573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197f738b-0210-40a5-b1fc-fbec110cc573', 'volume_size': 1} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1859837649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197f738b-0210-40a5-b1fc-fbec110cc573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:39Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Creating volume 197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:39 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" returned: 0 in 0.603s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:39 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:39 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 1073741824 Jul 28 14:33:39 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Deleted volume successfully. Jul 28 14:33:39 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f Jul 28 14:33:39 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afd2cb8c-c069-4ac4-81c8-6ce406f5ad72 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-9a9efa66-8364-40a0-b5b7-5b272efffb70-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:40 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" returned: 0 in 0.442s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (0893a1be-294d-47d7-bbe0-64c94605867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547e3934-35db-4c4d-9fab-c5033d62db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-fbfa27ef-acf4-48a2-8f1c-ada3d425fa9f" released by "delete_volume" :: held 1.164s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547e3934-35db-4c4d-9fab-c5033d62db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717653038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1891de83-687c-4c03-bb9f-75c89f518424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:40Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360db592-c7a8-49d2-a0da-03c09a717c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360db592-c7a8-49d2-a0da-03c09a717c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ead2089-6a20-4f27-b443-d03c149cde52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ead2089-6a20-4f27-b443-d03c149cde52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1891de83-687c-4c03-bb9f-75c89f518424', 'volume_name': 'volume-1891de83-687c-4c03-bb9f-75c89f518424', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd958f1-e3cb-459a-ae21-7792d3a9319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd958f1-e3cb-459a-ae21-7792d3a9319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0040f3d-7a0e-44cc-92e7-c8e5a0e894a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Volume 1891de83-687c-4c03-bb9f-75c89f518424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1891de83-687c-4c03-bb9f-75c89f518424', 'volume_size': 1} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['a860beb1-7c6e-4d1c-b4bf-56a10d33dadb'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:40 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 1073741824" returned: 0 in 0.688s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:40 devstack cinder-volume[87385]: WARNING cinder.quota [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-445434938 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-445434938, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['4425a0d5-7deb-440d-87e6-06fcd750e940', '5ad25a51-407a-4219-bfec-87ab7a9e1118', 'c457a651-9532-4784-aff5-a4ecad66fed5', '39c5d896-3db4-4c76-9a7a-1b3c28c4736c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-c78f588c-61d8-4874-80de-c8b94800be50 req-5ee6c402-d4a1-4c37-b6b4-83aeb3da347a tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:40 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:33:40 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['10f91123-3691-421e-a1ae-fc3187d417e7', '25607df9-8fa9-4a81-a292-238501fdadd1', '1d58458c-e376-41b9-b32b-0541a980599c', 'e16fd91c-edd9-44ed-bde1-75c6f4056b17'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:40 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:40 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:40 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-717653038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1891de83-687c-4c03-bb9f-75c89f518424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6aa55d642b4a8fb8bb19780c9c42da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:40Z,use_quota=True,user_id='1d8a2e8c0b29467db63b63c329bca01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Creating volume 1891de83-687c-4c03-bb9f-75c89f518424 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:40 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751bebdd-8ec5-4606-b090-5d3de19dfbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197f738b-0210-40a5-b1fc-fbec110cc573', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 1073741824 Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063eb55c-0bcd-42d2-8952-24efd8576a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:40 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Volume volume-197f738b-0210-40a5-b1fc-fbec110cc573 (197f738b-0210-40a5-b1fc-fbec110cc573): created successfully Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063eb55c-0bcd-42d2-8952-24efd8576a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (fea3ddf8-6102-4b35-9066-4b6bf287c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1a079519-35ba-48ff-8295-817de115084c tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:33:41 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-42030e8d-ebee-496b-92df-a40da1f367e8 tempest-GroupSnapshotsTest-1530526815 None] Delete group completed successfully. Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a46fe051-1636-4602-bdb4-618f713bac24 tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-1868309973: creating Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a46fe051-1636-4602-bdb4-618f713bac24 tempest-GroupSnapshotsTest-1530526815 None] Group tempest-GroupSnapshotsTest-Group-1868309973: created successfully Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a46fe051-1636-4602-bdb4-618f713bac24 tempest-GroupSnapshotsTest-1530526815 None] Create group completed successfully. Jul 28 14:33:41 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 1073741824" returned: 0 in 0.496s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:41 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 Jul 28 14:33:41 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:41 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-c78f588c-61d8-4874-80de-c8b94800be50 req-5ee6c402-d4a1-4c37-b6b4-83aeb3da347a tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.060s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-c78f588c-61d8-4874-80de-c8b94800be50 req-5ee6c402-d4a1-4c37-b6b4-83aeb3da347a tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0040f3d-7a0e-44cc-92e7-c8e5a0e894a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1891de83-687c-4c03-bb9f-75c89f518424', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7d11a6-efeb-46e1-a558-ca1659b58f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Volume volume-1891de83-687c-4c03-bb9f-75c89f518424 (1891de83-687c-4c03-bb9f-75c89f518424): created successfully Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7d11a6-efeb-46e1-a558-ca1659b58f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Flow 'volume_create_manager' (0893a1be-294d-47d7-bbe0-64c94605867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-c78f588c-61d8-4874-80de-c8b94800be50 req-5ee6c402-d4a1-4c37-b6b4-83aeb3da347a tempest-AttachVolumeTestJSON-668992739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-fa2294b7-4f00-442c-bec0-e469aa363a9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '397e3b04-149c-496f-aea8-d84b59725f46', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-174d3851-c7b3-4e9d-b213-1302a2f5e8db tempest-ProjectReaderTests-1819653783 None] Created volume successfully. Jul 28 14:33:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-c78f588c-61d8-4874-80de-c8b94800be50 req-5ee6c402-d4a1-4c37-b6b4-83aeb3da347a tempest-AttachVolumeTestJSON-668992739 None] attachment_update completed successfully. Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (ccf9b0fd-081c-4877-adf7-f52e1f0fe95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca236854-74c6-4f74-b85b-0d5e00f921dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca236854-74c6-4f74-b85b-0d5e00f921dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-609870297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010746eb-14af-48b5-8347-834c4fb3fd52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=197f738b-0210-40a5-b1fc-fbec110cc573,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:42Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985f4db0-196e-4ed2-83da-8feb94042cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985f4db0-196e-4ed2-83da-8feb94042cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a0ea9d-be4c-48d2-b426-5dde8f4020b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a0ea9d-be4c-48d2-b426-5dde8f4020b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '010746eb-14af-48b5-8347-834c4fb3fd52', 'volume_name': 'volume-010746eb-14af-48b5-8347-834c4fb3fd52', 'volume_size': 1, 'source_volid': '197f738b-0210-40a5-b1fc-fbec110cc573', 'source_volstatus': 'available'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f250a23-e497-4c60-b500-0fd2bf27b29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f250a23-e497-4c60-b500-0fd2bf27b29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45777239-e74d-48d3-a319-e4718f2a6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Volume 010746eb-14af-48b5-8347-834c4fb3fd52: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-010746eb-14af-48b5-8347-834c4fb3fd52', 'volume_size': 1, 'source_volid': '197f738b-0210-40a5-b1fc-fbec110cc573', 'source_volstatus': 'available'} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:42 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Cloning volume 197f738b-0210-40a5-b1fc-fbec110cc573 to volume 010746eb-14af-48b5-8347-834c4fb3fd52 Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Creating offline snapshot c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd of volume 197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f12e70-d40c-4cd2-bcc0-ae6e9a48a7cd]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-1891de83-687c-4c03-bb9f-75c89f518424-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-1891de83-687c-4c03-bb9f-75c89f518424-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:42 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:33:42 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "cinder-quobyte-1891de83-687c-4c03-bb9f-75c89f518424" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-1891de83-687c-4c03-bb9f-75c89f518424" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ac5c8-893a-44c3-9c35-236f02a1833d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:42 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 Jul 28 14:33:42 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:42 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.517s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:42 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd 1G Jul 28 14:33:42 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:43 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424" returned: 0 in 0.592s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:43 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424 Jul 28 14:33:43 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (91e70099-2c0d-4b13-8cad-d2a0b9f895ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055f7bce-c79b-4a95-9745-7e206fa7107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055f7bce-c79b-4a95-9745-7e206fa7107a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429877589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ae714df-025f-434e-8693-defec98095f0,host='devstack@QuobyteHD#QuobyteHD',id=9c58cb51-ffdd-4ce3-a281-1206b69ccadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:43Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e774e159-cd96-470f-9d0b-5069b2d0695c),volume_type_id=e774e159-cd96-470f-9d0b-5069b2d0695c)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba97fe-9a24-4277-9c79-e54beebb1d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba97fe-9a24-4277-9c79-e54beebb1d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f51f5a7-9469-4014-b64a-59855cb15c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f51f5a7-9469-4014-b64a-59855cb15c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c58cb51-ffdd-4ce3-a281-1206b69ccadd', 'volume_name': 'volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361c11ad-dbbf-4894-aad5-586f51f48ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361c11ad-dbbf-4894-aad5-586f51f48ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033d6f4-a104-4b40-b193-9ddcd945806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:43 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Volume 9c58cb51-ffdd-4ce3-a281-1206b69ccadd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd', 'volume_size': 1} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:43 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd 1G" returned: 0 in 0.492s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197f738b-0210-40a5-b1fc-fbec110cc573 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:43 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197f738b-0210-40a5-b1fc-fbec110cc573 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:43 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:43 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1891de83-687c-4c03-bb9f-75c89f518424" returned: 0 in 0.293s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-quobyte-1891de83-687c-4c03-bb9f-75c89f518424" released by "delete_volume" :: held 0.942s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Created reservations ['8e341953-150b-4ed1-b34b-b94023c6a6f4', '1c76b69a-35bc-411a-bf03-61aea4261688', 'ffa05ab7-aa85-445c-846b-676048f46b45', 'c8d2b48f-9476-4393-9c6f-582afa9abe56'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:43 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:43 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:43 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197f738b-0210-40a5-b1fc-fbec110cc573 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.306s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd is being set with open permissions: ugo+rw Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:43 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:43 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:43 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Deleted volume successfully. Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d3f70c5a-dcd8-4754-aeb9-ed8e29e9fc33 tempest-ProjectReaderTests-1819653783 None] Lock "cinder-1891de83-687c-4c03-bb9f-75c89f518424-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:43 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:43 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info Jul 28 14:33:43 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:44 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:44 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info is being set with open permissions: ugo+rw Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:44 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info Jul 28 14:33:44 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (2e6911ce-2696-4784-8104-b3a94b61c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2847ebe-006a-40dc-9e22-363320e9d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2847ebe-006a-40dc-9e22-363320e9d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1360684226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:44Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f29673-0a8c-4dd4-b72a-8e0d83a01d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f29673-0a8c-4dd4-b72a-8e0d83a01d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:44 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078d984d-f58b-457b-a176-b3e03f4c6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078d984d-f58b-457b-a176-b3e03f4c6eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812', 'volume_name': 'volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b01847a-69f2-41ea-b62c-2765ea375a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b01847a-69f2-41ea-b62c-2765ea375a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40e123a-2ac6-4f32-a2d6-7cfa7f3b2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:44 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Volume a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812', 'volume_size': 1} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.info" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] snapshot: c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd, volume: 010746eb-14af-48b5-8347-834c4fb3fd52, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8076f-8048-46d0-8d95-b9ab6e0f4f14]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:44 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:44 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:44 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.366s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197f738b-0210-40a5-b1fc-fbec110cc573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ab8f3-b915-44e0-bb4f-63b1235b0a1d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:45 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:33:45 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:45 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.405s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:45 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:33:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:45 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 Jul 28 14:33:45 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:49 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:49 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:49 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 28 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:33:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:33:50 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52" returned: 0 in 4.764s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1129eb-cdd6-459c-ac3a-04165cd0efc3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:50 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:33:50 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:50 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.500s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:33:50 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Converted 1024.00 MB image at 214.87 MB/s Jul 28 14:33:50 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 is being set with open permissions: ugo+rw Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:50 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 Jul 28 14:33:50 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:50 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" released by "_copy_volume_from_snapshot" :: held 6.352s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Deleting offline snapshot c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd of volume 197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] snapshot_file for this snap is: volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf34f7a4-542f-4b9b-9e43-1004705158cb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:51 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:51 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:51 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197f738b-0210-40a5-b1fc-fbec110cc573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53ae5c-23c6-4d75-8664-fb9b88068a1f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:51 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:33:51 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:51 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:51 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:51 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:51 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:51 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd Jul 28 14:33:51 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:52 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573.c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-c6dd685e-2298-4d0a-9de4-e0c0c1bfcfdd" released by "_delete_snapshot" :: held 1.349s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.018s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ae714df-025f-434e-8693-defec98095f0,created_at=2026-07-28T12:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-429877589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ae714df-025f-434e-8693-defec98095f0,host='devstack@QuobyteHD#QuobyteHD',id=9c58cb51-ffdd-4ce3-a281-1206b69ccadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62dafa0000f443c6b4d857e05c4967aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:43Z,use_quota=True,user_id='1f1a541afb0246129a1a5a0795dadac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e774e159-cd96-470f-9d0b-5069b2d0695c),volume_type_id=e774e159-cd96-470f-9d0b-5069b2d0695c)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Creating volume 9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:52 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:52 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd 1073741824 Jul 28 14:33:52 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45777239-e74d-48d3-a319-e4718f2a6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010746eb-14af-48b5-8347-834c4fb3fd52', 'volume_size': 1, 'source_volid': '197f738b-0210-40a5-b1fc-fbec110cc573', 'source_volstatus': 'available'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde4fcc-a87d-41bd-aa72-3a2156c61815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:52 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Volume volume-010746eb-14af-48b5-8347-834c4fb3fd52 (010746eb-14af-48b5-8347-834c4fb3fd52): created successfully Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde4fcc-a87d-41bd-aa72-3a2156c61815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (ccf9b0fd-081c-4877-adf7-f52e1f0fe95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-98244985-4d4a-43fe-848e-def487929f8f tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:33:52 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd 1073741824" returned: 0 in 0.402s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:52 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd Jul 28 14:33:52 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:52 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" returned: 0 in 0.235s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.479s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1360684226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3a70ca4cdb4935b721f10698b98d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:44Z,use_quota=True,user_id='14511049439546d6b51187e7dbe70506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Creating volume a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:52 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033d6f4-a104-4b40-b193-9ddcd945806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:52 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 1073741824 Jul 28 14:33:52 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d694cac-0e52-4f55-bed2-9bc117f655a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Volume volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd (9c58cb51-ffdd-4ce3-a281-1206b69ccadd): created successfully Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d694cac-0e52-4f55-bed2-9bc117f655a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Flow 'volume_create_manager' (91e70099-2c0d-4b13-8cad-d2a0b9f895ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dcea335d-1a26-4f52-a90e-1c9e9eadde0c tempest-GroupSnapshotsTest-1530526815 None] Created volume successfully. Jul 28 14:33:53 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 1073741824" returned: 0 in 0.470s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:53 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 Jul 28 14:33:53 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] GroupSnapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: creating. Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Group snapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: creating. {{(pid=87385) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:53 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.203s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Creating offline snapshot bce411ad-0aca-4568-bc4a-d245d573675e of volume 9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40e123a-2ac6-4f32-a2d6-7cfa7f3b2565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0b2db4-eefe-4e4d-b1c8-3ac884bc7569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[74111cd7-6185-4efc-9151-aa6f66ca37cf]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Volume volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 (a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812): created successfully Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0b2db4-eefe-4e4d-b1c8-3ac884bc7569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Flow 'volume_create_manager' (2e6911ce-2696-4784-8104-b3a94b61c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (5402b40d-ccd4-4c59-9bf1-76b3887ab50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed657a5-953a-4f49-883a-c731e36f78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed657a5-953a-4f49-883a-c731e36f78fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-493490624',display_name='tempest-VolumesGetTest-Volume-1766016206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11ac4d-40bd-4e08-92a6-07501d99e8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:54Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8369f1-f03f-4256-8caa-9985d454afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8369f1-f03f-4256-8caa-9985d454afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc8adaa-91c2-4feb-b9fa-32703f07990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc8adaa-91c2-4feb-b9fa-32703f07990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b11ac4d-40bd-4e08-92a6-07501d99e8d0', 'volume_name': 'volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd Jul 28 14:33:53 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae12fc-abc1-4dc8-bcf7-63f04ec130c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccae12fc-abc1-4dc8-bcf7-63f04ec130c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba30a0f7-596b-4924-9600-5751dbd59c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Volume 0b11ac4d-40bd-4e08-92a6-07501d99e8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0', 'volume_size': 1} Jul 28 14:33:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-738a7336-c3d3-4c73-8993-b1be8728b5dc tempest-AttachVolumeTestJSON-668992739 None] Created volume successfully. Jul 28 14:33:54 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" returned: 0 in 0.361s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:54 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e 1G Jul 28 14:33:54 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:54 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e 1G" returned: 0 in 0.430s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:54 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e Jul 28 14:33:54 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:54 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e" returned: 0 in 0.315s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:54 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:54 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e Jul 28 14:33:54 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:55 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:55 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info Jul 28 14:33:55 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-185fceef-a637-4f5d-9b44-3e2106579212 req-d5b97cbc-08d7-4651-8e62-d3c51ec9b9b0 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:55 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:55 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:55 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info Jul 28 14:33:55 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:55 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.info" returned: 0 in 0.248s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.796s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:33:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-493490624',display_name='tempest-VolumesGetTest-Volume-1766016206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11ac4d-40bd-4e08-92a6-07501d99e8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:33:54Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Creating volume 0b11ac4d-40bd-4e08-92a6-07501d99e8d0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:33:55 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:33:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:55 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 1073741824 Jul 28 14:33:55 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:55 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f2bf59aa-65f2-4a16-9bf1-cfcb167dd9aa tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: created successfully Jul 28 14:33:56 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 1073741824" returned: 0 in 0.421s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:56 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 Jul 28 14:33:56 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:56 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" returned: 0 in 0.236s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-185fceef-a637-4f5d-9b44-3e2106579212 req-d5b97cbc-08d7-4651-8e62-d3c51ec9b9b0 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.135s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba30a0f7-596b-4924-9600-5751dbd59c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f30eef-f9cf-48d6-af27-dd534c6c2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-185fceef-a637-4f5d-9b44-3e2106579212 req-d5b97cbc-08d7-4651-8e62-d3c51ec9b9b0 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Volume volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 (0b11ac4d-40bd-4e08-92a6-07501d99e8d0): created successfully Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f30eef-f9cf-48d6-af27-dd534c6c2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (5402b40d-ccd4-4c59-9bf1-76b3887ab50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:33:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4a0b41c7-0501-4691-9cf3-b6fe28825adf tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-185fceef-a637-4f5d-9b44-3e2106579212 req-d5b97cbc-08d7-4651-8e62-d3c51ec9b9b0 tempest-AttachVolumeTestJSON-668992739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5e8f2cc-ec76-4f64-9257-2ed9af1f5bbf', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:33:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-185fceef-a637-4f5d-9b44-3e2106579212 req-d5b97cbc-08d7-4651-8e62-d3c51ec9b9b0 tempest-AttachVolumeTestJSON-668992739 None] attachment_update completed successfully. Jul 28 14:33:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: deleting Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: deleting {{(pid=87385) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-bce411ad-0aca-4568-bc4a-d245d573675e" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-bce411ad-0aca-4568-bc4a-d245d573675e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Deleting offline snapshot bce411ad-0aca-4568-bc4a-d245d573675e of volume 9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] snapshot_file for this snap is: volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c146f9-5f1e-405a-8394-ae8f586a48b5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-0b11ac4d-40bd-4e08-92a6-07501d99e8d0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "cinder-0b11ac4d-40bd-4e08-92a6-07501d99e8d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:57 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e Jul 28 14:33:57 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9be211-d9ab-479d-a458-dbbee28d2e42]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:57 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 Jul 28 14:33:57 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:57 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e" returned: 0 in 0.473s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c4c422-9d43-4f68-926d-2d96670bbf89]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:57 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:57 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd Jul 28 14:33:57 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" returned: 0 in 0.392s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:57 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0 Jul 28 14:33:57 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:57 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" returned: 0 in 0.356s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:57 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:57 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e Jul 28 14:33:57 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-0b11ac4d-40bd-4e08-92a6-07501d99e8d0" released by "delete_volume" :: held 0.720s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Created reservations ['548c10a9-1188-4a8a-b127-4aefd523acb4', '19b0d7c6-72c2-4bad-b378-1914bd4a8686', '348f43e1-cffb-4c69-9f25-0b0a31ae8f6c', '8d815139-b627-4505-92bc-0feed0b29310'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:58 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:58 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:58 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e" returned: 0 in 0.422s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:58 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:58 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e Jul 28 14:33:58 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-010746eb-14af-48b5-8347-834c4fb3fd52-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "cinder-010746eb-14af-48b5-8347-834c4fb3fd52-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-89a77055-5fdf-4838-b4b1-6570303e857d tempest-VolumesGetTest-934453715 None] Lock "cinder-0b11ac4d-40bd-4e08-92a6-07501d99e8d0-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf1435c-35b0-4f58-bb02-766a6633db38]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:58 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd.bce411ad-0aca-4568-bc4a-d245d573675e" returned: 0 in 0.312s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:58 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 Jul 28 14:33:58 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-bce411ad-0aca-4568-bc4a-d245d573675e" released by "_delete_snapshot" :: held 1.748s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" released by "delete_snapshot" :: held 1.795s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:58 devstack cinder-volume[87385]: WARNING cinder.quota [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-861228178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-861228178, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:58 devstack cinder-volume[87385]: WARNING cinder.quota [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-861228178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-861228178, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['4edf9cfe-04b3-4170-9884-504feba0abb6', '6d3ec766-203d-4ad9-8414-1350d043cce7', 'bee525e6-d6e0-4580-bc6c-d6ea5ac10b10', '590e1876-1aec-4b8a-abb2-66d376990f11'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2ec85f1a-17d2-4b6f-9c75-9654a67b7fb5 tempest-GroupSnapshotsTest-1530526815 None] group_snapshot 57e8b2fd-b3c7-4a09-a0c4-3afe4b8aa614: deleted successfully Jul 28 14:33:58 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52" returned: 0 in 0.405s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:59 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52 Jul 28 14:33:59 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:59 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-010746eb-14af-48b5-8347-834c4fb3fd52" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-010746eb-14af-48b5-8347-834c4fb3fd52" released by "delete_volume" :: held 0.731s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Created reservations ['39a397b1-a6bf-4fe3-a0b0-7a2e1805c3e9', '9789fb56-c15d-4ff5-9a38-40fb9f824691', 'd5d51675-b7d8-4d45-8daf-d88e97bafe07', 'ad53af7a-bc10-4322-a286-e5bef41ec8b7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:59 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:33:59 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59cee05-f7dc-455e-bbcd-0eaec5dfe2d4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:33:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-564dbb03-0294-45da-9256-5b52460a6baa req-5d756d49-a754-4917-95ef-340bfc1f2cc3 tempest-AttachVolumeTestJSON-668992739 None] Terminate volume connection completed successfully. Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-564dbb03-0294-45da-9256-5b52460a6baa req-5d756d49-a754-4917-95ef-340bfc1f2cc3 tempest-AttachVolumeTestJSON-668992739 None] Deleting attachment 397e3b04-149c-496f-aea8-d84b59725f46. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:33:59 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.312s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:33:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-48c7c365-d43f-45f2-87ee-e6094696616a tempest-VolumesGetTest-934453715 None] Lock "cinder-010746eb-14af-48b5-8347-834c4fb3fd52-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-197f738b-0210-40a5-b1fc-fbec110cc573-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "cinder-197f738b-0210-40a5-b1fc-fbec110cc573-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:59 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd Jul 28 14:33:59 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-197f738b-0210-40a5-b1fc-fbec110cc573" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-197f738b-0210-40a5-b1fc-fbec110cc573" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea065552-0bdf-41ce-bf65-656b54fabd4c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:33:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:00 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:34:00 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:00 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" returned: 0 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:00 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd Jul 28 14:34:00 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:00 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.387s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:00 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573 Jul 28 14:34:00 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:00 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Lock "cinder-quobyte-9c58cb51-ffdd-4ce3-a281-1206b69ccadd" released by "delete_volume" :: held 0.845s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['87e71f33-74c7-461b-913f-616fd7b63c45'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:00 devstack cinder-volume[87385]: WARNING cinder.quota [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-861228178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-861228178, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Created reservations ['bf35e204-ae6a-4aea-9691-732c35c5f5ec', '3185c3f8-56d3-4cd6-a0fa-290b8f17b781', '034a7a99-250e-48cb-a9bc-e9adf5254ea3', 'b3ef712b-e5e8-4269-97ae-878bdd869844'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:00 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-197f738b-0210-40a5-b1fc-fbec110cc573" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-197f738b-0210-40a5-b1fc-fbec110cc573" released by "delete_volume" :: held 0.751s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:00 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:00 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Created reservations ['13894ca7-929e-494c-8601-31c520f84656', 'c722b926-77f1-461b-91af-3ad14168ab48', 'cd275045-9ceb-4c5c-999c-7111cc2c2171', '6368647c-e274-4ed3-9836-e414956a4fa7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:00 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:00 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:00 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.306s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:00 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:00 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d30dfa95-98d1-4003-b043-b535f72d9d4a tempest-GroupSnapshotsTest-1530526815 None] Delete group completed successfully. Jul 28 14:34:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-59c062a7-6834-4c16-a388-8ada61626069 req-72fb6409-6ff5-467c-9ab0-462ed09a55f9 tempest-AttachVolumeTestJSON-668992739 None] Terminate volume connection completed successfully. Jul 28 14:34:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-59c062a7-6834-4c16-a388-8ada61626069 req-72fb6409-6ff5-467c-9ab0-462ed09a55f9 tempest-AttachVolumeTestJSON-668992739 None] Deleting attachment c5e8f2cc-ec76-4f64-9257-2ed9af1f5bbf. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:34:01 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:01 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:34:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14b0772f-2c4e-487e-b5c1-b691156e4f45 tempest-VolumesGetTest-934453715 None] Lock "cinder-197f738b-0210-40a5-b1fc-fbec110cc573-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (f282e5fe-eac2-4291-a110-71021dfae553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a0d822-109b-45e7-b3f2-5112f07f32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a0d822-109b-45e7-b3f2-5112f07f32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-8686208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896bc97-7c69-4098-8cca-69e80b342dab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:02Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce413594-9412-4b86-9eb7-749cf9ceaca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce413594-9412-4b86-9eb7-749cf9ceaca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ef3e4a-d01d-4734-b528-4887fca8ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:02 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ef3e4a-d01d-4734-b528-4887fca8ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd896bc97-7c69-4098-8cca-69e80b342dab', 'volume_name': 'volume-d896bc97-7c69-4098-8cca-69e80b342dab', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c35224-d374-4aa7-bac7-18ea3ac77964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c35224-d374-4aa7-bac7-18ea3ac77964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16976f5e-b7fe-4612-9d0a-ec0cc32adfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:03 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Volume d896bc97-7c69-4098-8cca-69e80b342dab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d896bc97-7c69-4098-8cca-69e80b342dab', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Trying to clone d896bc97-7c69-4098-8cca-69e80b342dab from image b313c492-604e-4cdd-96f9-0cabb9f2068f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:34:03 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Image download 20.69 MB at 20.69 MB/s Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4278cf-5531-4d17-987e-dfb1b768c90a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:03 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD Jul 28 14:34:03 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:04 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f is fetched for user 6e4fade7fed443c4b14944033f13b6d1. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:INSERT=50,cinder:UPDATE=265,cinder:SELECT=246,cinder:DELETE=15 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=264,cinder:SELECT=213,cinder:INSERT=83,cinder:DELETE=17 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[70591620-150f-45b7-9090-6cb113f0b906]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:04 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD Jul 28 14:34:04 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:04 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-8686208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896bc97-7c69-4098-8cca-69e80b342dab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:02Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Creating volume d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:04 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:04 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1073741824 Jul 28 14:34:04 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:05 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1073741824" returned: 0 in 0.496s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:05 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab Jul 28 14:34:05 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:05 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Attempting download of b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume d896bc97-7c69-4098-8cca-69e80b342dab. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f27650-8c91-4d8f-bb00-a67d8917d9a7]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:05 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct Jul 28 14:34:05 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:05 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct" returned: 0 in 0.387s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:05 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct Jul 28 14:34:05 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:06 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct" returned: 1 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_unx8vfct' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e35c2ac-fe31-4dfe-90d1-776cbd7a7ff3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:06 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD Jul 28 14:34:06 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-quobyte-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc64c67-0d21-4061-a56a-0409eee1a285]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:06 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] b313c492-604e-4cdd-96f9-0cabb9f2068f was qcow2, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:06 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 Jul 28 14:34:06 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:06 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab Jul 28 14:34:06 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:06 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" returned: 0 in 0.402s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:06 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812 Jul 28 14:34:06 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:07 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" returned: 0 in 0.299s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812" released by "delete_volume" :: held 0.757s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Created reservations ['c65750b4-d6ce-42b2-bfd8-8eb400b5d144', '52ff5fd5-9ef0-4892-ab9e-3a7ed0c5caf8', '193116c6-7702-4354-8353-78f8fe4b3c98', '99a8c9ac-ecf8-4cdc-9f5e-bcd5abad6425'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:07 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:07 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Flow 'volume_create_manager' (d3ae3930-5578-4c8a-a690-f4a6cb69c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba30b9-65d2-4582-85bb-900b16f27368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-fa2294b7-4f00-442c-bec0-e469aa363a9e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba30b9-65d2-4582-85bb-900b16f27368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-562349853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3f9c8d-411d-4fc9-b07d-81c2109d66f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe3b1dfeb40d4a05a3a392e7fa141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:08Z,use_quota=True,user_id='654bc70eb27548c4a2d5f6638b84caa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985551a2-f6de-4321-bbd8-78e7bbc2f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985551a2-f6de-4321-bbd8-78e7bbc2f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:07 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0d5761-ed0c-44d5-ba45-97a301f3920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0d5761-ed0c-44d5-ba45-97a301f3920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3f9c8d-411d-4fc9-b07d-81c2109d66f5', 'volume_name': 'volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0337ad1a-75c9-4f71-93e9-21b98489861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0337ad1a-75c9-4f71-93e9-21b98489861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc2e343-64b7-47d1-bd39-b9da77294610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5', 'volume_size': 1} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-562349853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3f9c8d-411d-4fc9-b07d-81c2109d66f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe3b1dfeb40d4a05a3a392e7fa141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:08Z,use_quota=True,user_id='654bc70eb27548c4a2d5f6638b84caa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Creating volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.393s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-fa2294b7-4f00-442c-bec0-e469aa363a9e-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Deleted volume successfully. Jul 28 14:34:07 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 1073741824 Jul 28 14:34:07 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-50a6ccf5-dda6-4296-a4a1-57ee0bb8c326 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-a6bc3cb0-a0e0-4bc2-9404-ffcdedfcc812-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-quobyte-fa2294b7-4f00-442c-bec0-e469aa363a9e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-fa2294b7-4f00-442c-bec0-e469aa363a9e" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb5469-97c1-4dc6-924c-b08cd9ca241b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:07 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e Jul 28 14:34:07 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:08 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:08 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e Jul 28 14:34:08 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:08 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 1073741824" returned: 0 in 0.617s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:08 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 Jul 28 14:34:08 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:08 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab" returned: 0 in 1.869s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_oyk7p9grdevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:34:08 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Converted 112.00 MB image at 59.89 MB/s Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:08 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1G Jul 28 14:34:08 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:08 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fa2294b7-4f00-442c-bec0-e469aa363a9e" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-fa2294b7-4f00-442c-bec0-e469aa363a9e" released by "delete_volume" :: held 0.740s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Created reservations ['adea7b8d-509e-429b-a5ac-ed4f04d3dc9d', '1b2f888e-41db-47f1-bf75-9e4afb8920e7', 'c93df89a-684a-40ce-a530-cf069b8e4166', '07b10d06-b2c9-4ad3-89f2-ac7e62e1d1dd'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:08 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" returned: 0 in 0.300s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc2e343-64b7-47d1-bd39-b9da77294610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd76cf86-4ccc-4122-bba5-00e08d756f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:08 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Volume volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 (ad3f9c8d-411d-4fc9-b07d-81c2109d66f5): created successfully Jul 28 14:34:08 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:08 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd76cf86-4ccc-4122-bba5-00e08d756f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Flow 'volume_create_manager' (d3ae3930-5578-4c8a-a690-f4a6cb69c91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e4e0c6bc-d91f-45ea-bccc-abbd407b7caa tempest-SnapshotsActionsTest-470693973 None] Created volume successfully. Jul 28 14:34:08 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab 1G" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Downloaded image b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume d896bc97-7c69-4098-8cca-69e80b342dab successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f for user 6e4fade7fed443c4b14944033f13b6d1 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Marking volume d896bc97-7c69-4098-8cca-69e80b342dab as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Copying metadata from image b313c492-604e-4cdd-96f9-0cabb9f2068f to d896bc97-7c69-4098-8cca-69e80b342dab. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Creating volume glance metadata for volume d896bc97-7c69-4098-8cca-69e80b342dab backed by image b313c492-604e-4cdd-96f9-0cabb9f2068f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-a148600e-9fff-4766-ba4e-0bf0efe10409-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-a148600e-9fff-4766-ba4e-0bf0efe10409-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "cinder-quobyte-a148600e-9fff-4766-ba4e-0bf0efe10409" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:09 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16976f5e-b7fe-4612-9d0a-ec0cc32adfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d896bc97-7c69-4098-8cca-69e80b342dab', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc08827b-b515-473b-bc6a-5da88560cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-a148600e-9fff-4766-ba4e-0bf0efe10409" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Deleted volume successfully. Jul 28 14:34:09 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Volume volume-d896bc97-7c69-4098-8cca-69e80b342dab (d896bc97-7c69-4098-8cca-69e80b342dab): created successfully Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc08827b-b515-473b-bc6a-5da88560cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (f282e5fe-eac2-4291-a110-71021dfae553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9df786-276a-4768-9510-1982fd8af47e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1da73874-01fc-4d36-9d1e-2a44e05a249d tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-fa2294b7-4f00-442c-bec0-e469aa363a9e-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e1c3a042-6897-4b87-9549-6fdfa1d7886e tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:34:09 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 Jul 28 14:34:09 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:09 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:09 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409 Jul 28 14:34:09 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:09 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a148600e-9fff-4766-ba4e-0bf0efe10409" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-quobyte-a148600e-9fff-4766-ba4e-0bf0efe10409" released by "delete_volume" :: held 0.638s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Created reservations ['ea04b039-e022-44cc-9075-5657cc8d6132', 'cf37fafa-f047-4161-84d1-cc790944db31', '3553e3b7-011b-4ce3-b522-4b769f7f885e', '8b02a905-5f4b-4fee-ace1-59c56f819350'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:09 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:09 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Creating offline snapshot 2baab5ad-58da-44e2-aeb2-10a1778f87d7 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6de99c-ff6e-4795-8c96-d2574dc1461b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:10 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 Jul 28 14:34:10 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:10 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Deleted volume successfully. Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c3d01da9-68e6-4aaf-9fcd-cd6454f918d5 tempest-AttachVolumeTestJSON-668992739 None] Lock "cinder-a148600e-9fff-4766-ba4e-0bf0efe10409-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:10 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:10 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 1G Jul 28 14:34:10 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (6bf83dbd-ab4d-4a1e-b672-dd36e8d160a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bf5f6c-bcde-4996-9995-5a4f31ed9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bf5f6c-bcde-4996-9995-5a4f31ed9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713027604',display_name='tempest-VolumesGetTest-Volume-1194597668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d1a60d-5739-4756-90b5-be56eccdc591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:11Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c33c1f-bf2a-4fa9-97e3-45f1240fe2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c33c1f-bf2a-4fa9-97e3-45f1240fe2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3cc48f-faea-4fbe-8a78-357f9e0e99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3cc48f-faea-4fbe-8a78-357f9e0e99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d1a60d-5739-4756-90b5-be56eccdc591', 'volume_name': 'volume-a5d1a60d-5739-4756-90b5-be56eccdc591', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05629be-854b-4c84-9a27-c8b79bcfa36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05629be-854b-4c84-9a27-c8b79bcfa36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5675b571-69ba-4e96-bcc6-771076a51976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Volume a5d1a60d-5739-4756-90b5-be56eccdc591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d1a60d-5739-4756-90b5-be56eccdc591', 'volume_size': 1} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:10 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 1G" returned: 0 in 0.494s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:10 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:10 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:11 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.306s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:11 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 is being set with open permissions: ugo+rw Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:11 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:11 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:11 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:11 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info Jul 28 14:34:11 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:11 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info" returned: 0 in 0.292s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:11 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info is being set with open permissions: ugo+rw Jul 28 14:34:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:11 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info Jul 28 14:34:11 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:12 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.info" returned: 0 in 0.253s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713027604',display_name='tempest-VolumesGetTest-Volume-1194597668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d1a60d-5739-4756-90b5-be56eccdc591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec8ada0ead047bda9de004ac7180a92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:11Z,use_quota=True,user_id='6e4fade7fed443c4b14944033f13b6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Creating volume a5d1a60d-5739-4756-90b5-be56eccdc591 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:12 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:12 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 1073741824 Jul 28 14:34:12 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6d3e2878-a404-436b-93d4-7d96c7c52d62 tempest-SnapshotsActionsTest-470693973 None] Create snapshot completed successfully Jul 28 14:34:12 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 1073741824" returned: 0 in 0.452s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:12 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 Jul 28 14:34:12 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:12 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5675b571-69ba-4e96-bcc6-771076a51976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d1a60d-5739-4756-90b5-be56eccdc591', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc15f3-8cd0-4e40-b3e2-c8c8e9d1fff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Volume volume-a5d1a60d-5739-4756-90b5-be56eccdc591 (a5d1a60d-5739-4756-90b5-be56eccdc591): created successfully Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bc15f3-8cd0-4e40-b3e2-c8c8e9d1fff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Flow 'volume_create_manager' (6bf83dbd-ab4d-4a1e-b672-dd36e8d160a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2ba2139a-01dd-4e32-b149-2f4cbb3398ed tempest-VolumesGetTest-934453715 None] Created volume successfully. Jul 28 14:34:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Creating offline snapshot 60ba17f1-51ba-4828-bc74-67095d6a8ba7 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dc8485-4ee8-4a39-8ff9-58c46859ab8e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:13 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:13 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:14 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-a5d1a60d-5739-4756-90b5-be56eccdc591-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:14 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 1G Jul 28 14:34:14 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "cinder-a5d1a60d-5739-4756-90b5-be56eccdc591-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-a5d1a60d-5739-4756-90b5-be56eccdc591" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-a5d1a60d-5739-4756-90b5-be56eccdc591" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9af916-9bfb-4311-844a-60356bc6fb21]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:14 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 Jul 28 14:34:14 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:14 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 1G" returned: 0 in 0.558s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:14 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:14 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:14 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:14 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591 Jul 28 14:34:14 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:14 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a5d1a60d-5739-4756-90b5-be56eccdc591" returned: 0 in 0.262s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:14 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:14 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 is being set with open permissions: ugo+rw Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-a5d1a60d-5739-4756-90b5-be56eccdc591" released by "delete_volume" :: held 0.784s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:14 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 Jul 28 14:34:14 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Created reservations ['309f1abf-53a3-440a-9254-01e0fa578884', '45e9d357-bc27-4e02-9ee9-286244811b4a', '5e6cd2ed-78f0-475a-8ace-49b4ea767308', '3796cfc4-3cf7-4cd6-bd82-08c67bc0b014'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:15 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:15 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:15 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7" returned: 0 in 0.297s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.744s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-09836f84-5599-4488-ae19-615286047b17 tempest-SnapshotsActionsTest-470693973 None] Create snapshot completed successfully Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-d896bc97-7c69-4098-8cca-69e80b342dab-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:15 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "cinder-d896bc97-7c69-4098-8cca-69e80b342dab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9a773fd4-bcdf-43f6-a76b-6ad5aeb0f9de tempest-VolumesGetTest-934453715 None] Lock "cinder-a5d1a60d-5739-4756-90b5-be56eccdc591-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Acquiring lock "cinder-quobyte-d896bc97-7c69-4098-8cca-69e80b342dab" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-d896bc97-7c69-4098-8cca-69e80b342dab" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f64e6-0fa5-4d35-85cd-ad6bc4ad59b4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:15 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab Jul 28 14:34:15 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-60ba17f1-51ba-4828-bc74-67095d6a8ba7-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-60ba17f1-51ba-4828-bc74-67095d6a8ba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-60ba17f1-51ba-4828-bc74-67095d6a8ba7" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-60ba17f1-51ba-4828-bc74-67095d6a8ba7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Deleting offline snapshot 60ba17f1-51ba-4828-bc74-67095d6a8ba7 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] snapshot_file for this snap is: volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ed174-d536-4ef8-a36b-8dfec048615e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:15 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:15 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab Jul 28 14:34:15 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:16 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 Jul 28 14:34:16 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:16 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d896bc97-7c69-4098-8cca-69e80b342dab" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "cinder-quobyte-d896bc97-7c69-4098-8cca-69e80b342dab" released by "delete_volume" :: held 0.717s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Created reservations ['25fb15e9-0846-453e-b87e-2503dc07e0a5', '0a04a7af-7419-4c0a-80f2-e807872c5c57', 'e08165ac-58fd-4355-aa97-0698357093a3', 'f72b2dfe-863b-4ee9-8f06-b9963c11521f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:16 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7" returned: 0 in 0.407s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3704d-d02d-4ee4-8a79-db505ea6ce44]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:16 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:16 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:16 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:16 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:16 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Deleted volume successfully. Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd543674-b751-4939-aefa-76f15b7e3381 tempest-VolumesGetTest-934453715 None] Lock "cinder-d896bc97-7c69-4098-8cca-69e80b342dab-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:16 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:16 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 Jul 28 14:34:16 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:17 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7" returned: 0 in 0.452s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:17 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7 Jul 28 14:34:17 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7d331e77-ff9a-48fd-a121-aa45b65c694a tempest-GroupSnapshotsV319Test-1655505150 None] Group tempest-GroupSnapshotsV319Test-Group-471865450: creating Jul 28 14:34:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7d331e77-ff9a-48fd-a121-aa45b65c694a tempest-GroupSnapshotsV319Test-1655505150 None] Group tempest-GroupSnapshotsV319Test-Group-471865450: created successfully Jul 28 14:34:17 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.60ba17f1-51ba-4828-bc74-67095d6a8ba7" returned: 0 in 0.308s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7d331e77-ff9a-48fd-a121-aa45b65c694a tempest-GroupSnapshotsV319Test-1655505150 None] Create group completed successfully. Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-60ba17f1-51ba-4828-bc74-67095d6a8ba7" released by "_delete_snapshot" :: held 1.710s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_snapshot" :: held 1.736s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Created reservations ['ff38afc0-4547-4c1e-b615-1f5ba57f5e5e', '8ce6c2d9-7388-46e2-b707-c56476f1cb58', '90a3e7e5-9596-499a-935e-3a553d277eff', '62e89d73-871a-4ed6-8c84-4d3472b2d868'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Delete snapshot completed successfully. Jul 28 14:34:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db015014-8a14-47cd-9569-49f3582e8fc8 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-60ba17f1-51ba-4828-bc74-67095d6a8ba7-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Creating offline snapshot 55f38f53-9fe1-43fb-b160-e098c9df7df4 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fabc2d0-dfc6-4a7a-b943-8c7dc17a8dca]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:18 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:18 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:18 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:18 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 1G Jul 28 14:34:18 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Flow 'volume_create_manager' (ad04497a-1ae1-403d-b959-77671878b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64482166-67f7-4427-acd8-64fbbe0d3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64482166-67f7-4427-acd8-64fbbe0d3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962072100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30231f2f-5ddc-4266-9d05-30f8c140bcab,host='devstack@QuobyteHD#QuobyteHD',id=1d85fc70-100d-47e4-8042-0f3f4a6bf3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdf8d6b80264cf8a2c9929ebd566b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:19Z,use_quota=True,user_id='a752da2e40004790878ab4cd22efe177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b40cf1-4aec-4570-a185-40f8771f03de),volume_type_id=89b40cf1-4aec-4570-a185-40f8771f03de)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1e86cf-a8e5-45e5-b027-32c6ebc469c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1e86cf-a8e5-45e5-b027-32c6ebc469c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70474766-fbd3-4840-a33f-db53eaa941f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70474766-fbd3-4840-a33f-db53eaa941f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d85fc70-100d-47e4-8042-0f3f4a6bf3a7', 'volume_name': 'volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eec4372-fc16-4305-9537-daadc72ae28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eec4372-fc16-4305-9537-daadc72ae28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda8adba-7877-440b-aeea-56adf4039dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Volume 1d85fc70-100d-47e4-8042-0f3f4a6bf3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7', 'volume_size': 1} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:19 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 1G" returned: 0 in 0.586s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:19 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 Jul 28 14:34:19 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:19 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:19 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 is being set with open permissions: ugo+rw Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:19 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 Jul 28 14:34:19 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Flow 'volume_create_manager' (580f2411-62cb-4de5-9eb2-8695ef8fbdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:19 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0fdc18a-bbc6-46a9-8854-8f936ccb2635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0fdc18a-bbc6-46a9-8854-8f936ccb2635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1663553917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28d5c6-25d6-4e20-8863-f65152f5f511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de5891fd89946c9a28b26c519453c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:20Z,use_quota=True,user_id='203ef52bb2e94540a14cbc253dab08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e4f52c-31c1-4d73-9ed6-1bae504a63e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e4f52c-31c1-4d73-9ed6-1bae504a63e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2489e969-85a1-4268-93d7-a44b07a7cf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2489e969-85a1-4268-93d7-a44b07a7cf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d28d5c6-25d6-4e20-8863-f65152f5f511', 'volume_name': 'volume-0d28d5c6-25d6-4e20-8863-f65152f5f511', 'volume_size': 2}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2e8ba-8db1-4e83-a98b-18da499452a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2e8ba-8db1-4e83-a98b-18da499452a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d679bd99-186d-498f-ae3d-ce88a3b7ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Volume 0d28d5c6-25d6-4e20-8863-f65152f5f511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d28d5c6-25d6-4e20-8863-f65152f5f511', 'volume_size': 2} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.703s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30231f2f-5ddc-4266-9d05-30f8c140bcab,created_at=2026-07-28T12:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1962072100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30231f2f-5ddc-4266-9d05-30f8c140bcab,host='devstack@QuobyteHD#QuobyteHD',id=1d85fc70-100d-47e4-8042-0f3f4a6bf3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdf8d6b80264cf8a2c9929ebd566b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:19Z,use_quota=True,user_id='a752da2e40004790878ab4cd22efe177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b40cf1-4aec-4570-a185-40f8771f03de),volume_type_id=89b40cf1-4aec-4570-a185-40f8771f03de)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Creating volume 1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:19 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:20 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 1073741824 Jul 28 14:34:20 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d015b967-f0a8-4f48-9ac6-52e65ca54b78 tempest-SnapshotsActionsTest-470693973 None] Create snapshot completed successfully Jul 28 14:34:20 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 1073741824" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-55f38f53-9fe1-43fb-b160-e098c9df7df4-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:20 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 Jul 28 14:34:20 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-55f38f53-9fe1-43fb-b160-e098c9df7df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-55f38f53-9fe1-43fb-b160-e098c9df7df4" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-55f38f53-9fe1-43fb-b160-e098c9df7df4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Deleting offline snapshot 55f38f53-9fe1-43fb-b160-e098c9df7df4 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] snapshot_file for this snap is: volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7eb62d-706a-4c7e-a3f5-d146046be90a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:20 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 Jul 28 14:34:20 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:20 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" returned: 0 in 0.262s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1663553917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28d5c6-25d6-4e20-8863-f65152f5f511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1de5891fd89946c9a28b26c519453c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:20Z,use_quota=True,user_id='203ef52bb2e94540a14cbc253dab08c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Creating volume 0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 2147483648 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:20 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 2147483648 Jul 28 14:34:20 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda8adba-7877-440b-aeea-56adf4039dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51879340-9bd2-4f59-b20d-bcb5d6877f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Volume volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 (1d85fc70-100d-47e4-8042-0f3f4a6bf3a7): created successfully Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51879340-9bd2-4f59-b20d-bcb5d6877f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Flow 'volume_create_manager' (ad04497a-1ae1-403d-b959-77671878b873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c56033eb-c589-43df-a139-6a6f5fcfa086 tempest-GroupSnapshotsV319Test-1655505150 None] Created volume successfully. Jul 28 14:34:20 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f8ad1-5393-48d9-9823-2c0fd1807eb0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:21 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:21 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:21 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 2147483648" returned: 0 in 0.493s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:21 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 Jul 28 14:34:21 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:21 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:21 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 Jul 28 14:34:21 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:21 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511" returned: 0 in 0.262s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d679bd99-186d-498f-ae3d-ce88a3b7ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d28d5c6-25d6-4e20-8863-f65152f5f511', 'volume_size': 2}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70384b19-b573-4eb5-ae36-fed55d62a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Volume volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 (0d28d5c6-25d6-4e20-8863-f65152f5f511): created successfully Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70384b19-b573-4eb5-ae36-fed55d62a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Flow 'volume_create_manager' (580f2411-62cb-4de5-9eb2-8695ef8fbdb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-5ad3f193-d979-45be-8c39-72b956734825 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Created volume successfully. Jul 28 14:34:21 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:21 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4 Jul 28 14:34:21 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] GroupSnapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: creating. Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Group snapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: creating. {{(pid=87385) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Creating offline snapshot 32421c7d-beb7-471c-8e97-d95f9d0f196c of volume 1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7e4d9-771f-4238-a0d7-4a906dba33e9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:22 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.55f38f53-9fe1-43fb-b160-e098c9df7df4" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:22 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 Jul 28 14:34:22 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-55f38f53-9fe1-43fb-b160-e098c9df7df4" released by "_delete_snapshot" :: held 1.526s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_snapshot" :: held 1.550s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Created reservations ['7d61c87b-d3f3-427a-8e31-2ae3fc1cf8e0', '70be3560-2828-4596-9ebb-a67f9cd42883', 'dc745963-dda3-46be-87c1-87c525225fbb', 'a376fb05-bd56-40e6-a3cc-5ce30db1bad4'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Delete snapshot completed successfully. Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-642478ef-68d1-47ee-81f8-c1373c558b50 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-55f38f53-9fe1-43fb-b160-e098c9df7df4-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:22 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" returned: 0 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:22 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c 1G Jul 28 14:34:22 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:22 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c 1G" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:22 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c Jul 28 14:34:22 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:23 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:23 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:23 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c Jul 28 14:34:23 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:23 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:23 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info Jul 28 14:34:23 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:23 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:23 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:23 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info Jul 28 14:34:23 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:23 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.info" returned: 0 in 0.235s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.606s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Creating offline snapshot 5d0940ed-be33-43fb-a3f5-dcf6f0937932 of volume 0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb272e-3b33-4317-80ce-725ce32708e2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b7846366-5853-4cb2-b1f8-d1c34a734f55 tempest-GroupSnapshotsV319Test-1655505150 None] group_snapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: created successfully Jul 28 14:34:23 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 Jul 28 14:34:23 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:24 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511" returned: 0 in 0.374s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 2G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:24 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 2G Jul 28 14:34:24 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] group_snapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: deleting Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] group_snapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: deleting {{(pid=87385) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "cinder-quobyte-32421c7d-beb7-471c-8e97-d95f9d0f196c" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-32421c7d-beb7-471c-8e97-d95f9d0f196c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Deleting offline snapshot 32421c7d-beb7-471c-8e97-d95f9d0f196c of volume 1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] snapshot_file for this snap is: volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fd3ee8-c5ef-493b-890b-1ac05b562080]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:24 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c Jul 28 14:34:24 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:24 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 2G" returned: 0 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:24 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 Jul 28 14:34:24 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:24 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c" returned: 0 in 0.375s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc34a2b5-486b-4f14-abf5-647ca0f8f7db]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:24 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:24 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 is being set with open permissions: ugo+rw Jul 28 14:34:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:24 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 Jul 28 14:34:24 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 Jul 28 14:34:25 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932" returned: 0 in 0.230s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:25 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info Jul 28 14:34:25 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:25 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c Jul 28 14:34:25 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info is being set with open permissions: ugo+rw Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:25 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info Jul 28 14:34:25 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c" returned: 0 in 0.340s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:25 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c Jul 28 14:34:25 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.info" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.802s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Creating offline snapshot fdccf6a2-9f4b-4872-93ce-b99a5bd591bf of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c71720b6-bcad-41c2-a886-fa2ac00d43af tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Create snapshot completed successfully Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521863c-4c16-40cc-a87b-46738fceaf12]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:25 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7.32421c7d-beb7-471c-8e97-d95f9d0f196c" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-32421c7d-beb7-471c-8e97-d95f9d0f196c" released by "_delete_snapshot" :: held 1.471s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:25 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:25 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" released by "delete_snapshot" :: held 1.494s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:25 devstack cinder-volume[87385]: WARNING cinder.quota [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1703475547 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1703475547, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:34:25 devstack cinder-volume[87385]: WARNING cinder.quota [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1703475547 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1703475547, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] Created reservations ['9347a72a-12e1-404e-83ba-667805c12070', '3ab94ac5-7bc7-4883-a92f-8707a394037b', '062d01ff-56b7-4584-a10a-6e6055f5b368', 'e7f9d59f-719f-46fe-b6be-2934f4589817'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4a052879-b9cd-4914-96c9-fbc6c6f96351 tempest-GroupSnapshotsV319Test-1655505150 None] group_snapshot 0dbba889-ea03-4a14-9c77-045f7059a8dd: deleted successfully Jul 28 14:34:26 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.365s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:26 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf 1G Jul 28 14:34:26 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "cinder-5d0940ed-be33-43fb-a3f5-dcf6f0937932-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-5d0940ed-be33-43fb-a3f5-dcf6f0937932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "cinder-quobyte-5d0940ed-be33-43fb-a3f5-dcf6f0937932" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-5d0940ed-be33-43fb-a3f5-dcf6f0937932" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Deleting offline snapshot 5d0940ed-be33-43fb-a3f5-dcf6f0937932 of volume 0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] snapshot_file for this snap is: volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc50501-0d33-449e-97fd-0c58a7e76cd3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:26 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf 1G" returned: 0 in 0.513s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:26 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf Jul 28 14:34:26 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:26 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 Jul 28 14:34:26 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:27 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf is being set with open permissions: ugo+rw Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2973ee3-846b-4395-972c-107c29a361a6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932" returned: 0 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d28d5c6-25d6-4e20-8863-f65152f5f511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:27 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf Jul 28 14:34:27 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f113a8f-7a0f-4ba3-81b9-208fef7a97ce]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 Jul 28 14:34:27 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 Jul 28 14:34:27 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.591s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7c5f50c0-7a37-4747-9c3f-be133db60820 tempest-SnapshotsActionsTest-470693973 None] Create snapshot completed successfully Jul 28 14:34:27 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7 Jul 28 14:34:27 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 Jul 28 14:34:27 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" returned: 0 in 0.252s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "cinder-quobyte-1d85fc70-100d-47e4-8042-0f3f4a6bf3a7" released by "delete_volume" :: held 0.719s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Created reservations ['baa1c771-c255-406b-bc62-b54c16d51bd6'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:27 devstack cinder-volume[87385]: WARNING cinder.quota [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1703475547 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1703475547, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Created reservations ['c1744295-2157-432b-8a82-a1000ba70778', '195514cc-0243-4396-9466-304918b0b75b', '55269f45-16f5-4566-a38c-2707f9b21322', 'dbcd2c17-fb44-48d0-a2a3-1a5163597560'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:27 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932 Jul 28 14:34:27 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:27 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:27 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:28 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511.5d0940ed-be33-43fb-a3f5-dcf6f0937932" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-5d0940ed-be33-43fb-a3f5-dcf6f0937932" released by "_delete_snapshot" :: held 1.577s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" released by "delete_snapshot" :: held 1.606s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:28 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ebf6ee04-20dd-4d21-be27-89c2e6843463 tempest-GroupSnapshotsV319Test-1655505150 None] Delete group completed successfully. Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Created reservations ['127e0019-ae36-4e86-bf25-35a8d710f77d', 'f11486d8-71b8-4fbc-a9e6-79132cac3acb', '8f5553b1-f2b9-4519-a6d3-135751c0d072', '59bfb0a3-e517-4633-936b-f5ffaa93787b'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Delete snapshot completed successfully. Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Deleting offline snapshot fdccf6a2-9f4b-4872-93ce-b99a5bd591bf of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] snapshot_file for this snap is: volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eb262861-52f1-48e7-89fd-8cdbea3f6967 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-5d0940ed-be33-43fb-a3f5-dcf6f0937932-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[829a1061-7930-440c-a03e-8ceb659c73ba]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:28 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf Jul 28 14:34:28 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "cinder-0d28d5c6-25d6-4e20-8863-f65152f5f511-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:28 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" returned: 0 in 0.387s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-0d28d5c6-25d6-4e20-8863-f65152f5f511-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[910aef01-82cb-4a10-aee5-d89f6c7d0dcc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f18ed5-ef70-4d23-9d32-a42b31ccc0b1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:28 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:28 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 Jul 28 14:34:29 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.388s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:29 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf Jul 28 14:34:29 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:29 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511 Jul 28 14:34:29 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d28d5c6-25d6-4e20-8863-f65152f5f511" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-quobyte-0d28d5c6-25d6-4e20-8863-f65152f5f511" released by "delete_volume" :: held 0.734s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Created reservations ['50b623a0-82be-4923-9c53-0cc0f78f7aa1', 'b58f5daa-ed60-449f-aa2c-b648333c6680', 'daae96b6-ea4a-4dc2-b149-0aa04b7a3750', '97b5f57f-8db5-4380-937f-2ba930a2b1eb'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:29 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" returned: 0 in 0.463s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:29 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf Jul 28 14:34:29 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:29 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:29 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:29 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" returned: 0 in 0.321s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf" released by "_delete_snapshot" :: held 1.692s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_snapshot" :: held 1.720s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:30 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Deleted volume successfully. Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-574a8eb2-3850-4557-ab13-178bb0f6f148 tempest-VolumesSnapshotNegativeTestJSON-533751090 None] Lock "cinder-0d28d5c6-25d6-4e20-8863-f65152f5f511-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Created reservations ['44c46471-90c1-4a56-8324-7e660524982d', '5dde27a2-f0e2-45d7-9c79-f237e6bedcb7', 'e94809b6-3413-47c9-b923-77b454646b63', 'cd57af29-189e-432b-9fc7-58d75425cf7c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Delete snapshot completed successfully. Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-786cbbeb-2c26-4fda-8c00-215d1ffaf343 tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-fdccf6a2-9f4b-4872-93ce-b99a5bd591bf-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Creating offline snapshot 98d319c4-52b3-4f89-8f1e-998d9b95137a of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee04e08-110e-4863-a42a-ed28030f5d2d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:30 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:30 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:31 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.421s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:31 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a 1G Jul 28 14:34:31 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:31 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a 1G" returned: 0 in 0.526s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:31 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a Jul 28 14:34:31 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:32 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:32 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a is being set with open permissions: ugo+rw Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:32 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a Jul 28 14:34:32 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:32 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a" returned: 0 in 0.289s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.692s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8f8eef55-026c-4d16-a223-e533b49ab55b tempest-SnapshotsActionsTest-470693973 None] Create snapshot completed successfully Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-98d319c4-52b3-4f89-8f1e-998d9b95137a-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-98d319c4-52b3-4f89-8f1e-998d9b95137a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Acquiring lock "cinder-quobyte-98d319c4-52b3-4f89-8f1e-998d9b95137a" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-98d319c4-52b3-4f89-8f1e-998d9b95137a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Deleting offline snapshot 98d319c4-52b3-4f89-8f1e-998d9b95137a of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] snapshot_file for this snap is: volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbbc724-c352-4a18-866e-0c66cbe0340c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:33 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a Jul 28 14:34:33 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:33 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e90d1d-6682-4d97-9db9-293094fa06df]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:33 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:33 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:33 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:34 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a Jul 28 14:34:34 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:34 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a" returned: 0 in 0.486s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:34 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a Jul 28 14:34:34 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:34 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.98d319c4-52b3-4f89-8f1e-998d9b95137a" returned: 0 in 0.262s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-98d319c4-52b3-4f89-8f1e-998d9b95137a" released by "_delete_snapshot" :: held 1.728s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_snapshot" :: held 1.756s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Created reservations ['1d42bef3-f24e-4f0c-9d4c-699b797bdf18', 'f1c291f5-d0b8-474c-a485-9e7026b79c35', 'c173a493-f3e6-4088-af7d-c6a0b23ac9d3', 'ebd6925d-2b4e-487a-98b0-8bf61c2c1db2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Delete snapshot completed successfully. Jul 28 14:34:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e2924f7-838d-47a6-a2c8-2b84516a741f tempest-SnapshotsActionsTest-2117660070 None] Lock "cinder-98d319c4-52b3-4f89-8f1e-998d9b95137a-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Flow 'volume_create_manager' (43663c65-ba02-4b17-a3fd-c89752513fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf46114-819e-4050-b045-bd38bdd8a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf46114-819e-4050-b045-bd38bdd8a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1770164884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd75d24-4fe1-48e4-b4c8-5593661dc565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6c825976df49c7bf37e16dbc975d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:35Z,use_quota=True,user_id='7662b4ccf6324264842e55b60d9436d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb49139-90c0-4981-9fe6-4e83062602ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb49139-90c0-4981-9fe6-4e83062602ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e672655-3b16-401e-8d20-b0187922ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e672655-3b16-401e-8d20-b0187922ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd75d24-4fe1-48e4-b4c8-5593661dc565', 'volume_name': 'volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb914720-b2a4-4c97-b6a4-b52887118619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb914720-b2a4-4c97-b6a4-b52887118619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264945f4-1137-40d7-a7ff-aa3ab8786b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:35 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume 2bd75d24-4fe1-48e4-b4c8-5593661dc565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565', 'volume_size': 1} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1770164884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd75d24-4fe1-48e4-b4c8-5593661dc565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6c825976df49c7bf37e16dbc975d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:35Z,use_quota=True,user_id='7662b4ccf6324264842e55b60d9436d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Creating volume 2bd75d24-4fe1-48e4-b4c8-5593661dc565 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:35 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "cinder-2baab5ad-58da-44e2-aeb2-10a1778f87d7-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:35 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 1073741824 Jul 28 14:34:35 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-2baab5ad-58da-44e2-aeb2-10a1778f87d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "cinder-quobyte-2baab5ad-58da-44e2-aeb2-10a1778f87d7" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-2baab5ad-58da-44e2-aeb2-10a1778f87d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Deleting offline snapshot 2baab5ad-58da-44e2-aeb2-10a1778f87d7 of volume ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] snapshot_file for this snap is: volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d523ab9-2b03-411f-a35f-7233f578e6db]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:35 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:35 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:36 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 1073741824" returned: 0 in 0.484s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:36 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 Jul 28 14:34:36 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:36 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.426s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec150a-b432-4158-b1da-0d2f5a9c3789]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:36 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 Jul 28 14:34:36 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:36 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264945f4-1137-40d7-a7ff-aa3ab8786b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59b398-80e6-4981-bcde-71f87a98e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:36 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 (2bd75d24-4fe1-48e4-b4c8-5593661dc565): created successfully Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59b398-80e6-4981-bcde-71f87a98e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Flow 'volume_create_manager' (43663c65-ba02-4b17-a3fd-c89752513fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9c681cda-de7a-4c05-94b2-306bba2d5fa6 tempest-VolumeQuotasAdminTestJSON-443459426 None] Created volume successfully. Jul 28 14:34:36 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" returned: 0 in 0.429s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:36 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:36 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:36 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:36 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7 Jul 28 14:34:36 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:37 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5.2baab5ad-58da-44e2-aeb2-10a1778f87d7" returned: 0 in 0.247s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-2baab5ad-58da-44e2-aeb2-10a1778f87d7" released by "_delete_snapshot" :: held 1.558s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_snapshot" :: held 1.588s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Created reservations ['cf073c67-b7dc-4cdc-9cbc-7d096c4184d5', '7b408ae2-ccce-4f1d-9c09-3bb0f1323bb3', '6c8de05b-8cf6-4af3-b010-d113886dbc2e', '8d3ca87f-f5e8-422b-ba40-438d91279007'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Delete snapshot completed successfully. Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f35f7c3a-e38b-4a0d-a509-b22128e644c9 tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-2baab5ad-58da-44e2-aeb2-10a1778f87d7-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "cinder-2bd75d24-4fe1-48e4-b4c8-5593661dc565-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "cinder-2bd75d24-4fe1-48e4-b4c8-5593661dc565-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "cinder-quobyte-2bd75d24-4fe1-48e4-b4c8-5593661dc565" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "cinder-quobyte-2bd75d24-4fe1-48e4-b4c8-5593661dc565" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a0032-9c02-47c4-8109-01f957bdd4df]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:37 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 Jul 28 14:34:37 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "cinder-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ec48d-abdd-429d-8252-9e4b2a8e77dc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:38 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565" returned: 0 in 0.479s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:38 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565 Jul 28 14:34:38 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:38 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 Jul 28 14:34:38 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:38 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2bd75d24-4fe1-48e4-b4c8-5593661dc565" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "cinder-quobyte-2bd75d24-4fe1-48e4-b4c8-5593661dc565" released by "delete_volume" :: held 0.846s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:38 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Created reservations ['e918388a-b952-4273-9742-42fb03bac962', '1d895609-126a-42e9-a34b-975a42ece0bf', 'c362fe8a-a1d1-4ea5-8f54-4a5f6908f6e5', '7e9c7dfd-eddd-47a8-b59d-20053e4a6d42'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:38 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5 Jul 28 14:34:38 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:38 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:38 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:38 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" returned: 0 in 0.332s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-quobyte-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5" released by "delete_volume" :: held 0.870s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Created reservations ['60e25cf5-6d19-4c02-b137-efac5d81fc6f', '910ddf80-d9c4-4027-a9c9-7be7514aa563', 'e1b1e3b4-2fbe-4c4d-b046-dcaa8c1d7b97', 'bc9423ab-7836-46ef-b906-533f5e200130'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:39 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Deleted volume successfully. Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-59327c5c-5ccb-4792-bee9-96af2da8d60b tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "cinder-2bd75d24-4fe1-48e4-b4c8-5593661dc565-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:39 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:39 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:39 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Deleted volume successfully. Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Flow 'volume_create_manager' (63e83cca-c398-425a-8461-0db010e30bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0c4659-f6d3-46ca-8d16-315bbc08532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0c4659-f6d3-46ca-8d16-315bbc08532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2142362101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12ed09-acdd-4aa2-949b-602f9480b0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6c825976df49c7bf37e16dbc975d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:39Z,use_quota=True,user_id='7662b4ccf6324264842e55b60d9436d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9911e6d-34f0-4acd-accf-083245aac23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9911e6d-34f0-4acd-accf-083245aac23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcee3cf6-8c14-4ec4-9508-e1c29bb5d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcee3cf6-8c14-4ec4-9508-e1c29bb5d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be12ed09-acdd-4aa2-949b-602f9480b0ec', 'volume_name': 'volume-be12ed09-acdd-4aa2-949b-602f9480b0ec', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e457f801-c544-43d5-950d-abab169e2118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e457f801-c544-43d5-950d-abab169e2118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8093bbb-8b1a-4c96-b4b4-256a7c18fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:39 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume be12ed09-acdd-4aa2-949b-602f9480b0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be12ed09-acdd-4aa2-949b-602f9480b0ec', 'volume_size': 1} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2142362101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12ed09-acdd-4aa2-949b-602f9480b0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d6c825976df49c7bf37e16dbc975d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:39Z,use_quota=True,user_id='7662b4ccf6324264842e55b60d9436d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Creating volume be12ed09-acdd-4aa2-949b-602f9480b0ec {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:39 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-51ad018e-b4a9-47b2-b0d4-5e9c58f1f0df tempest-SnapshotsActionsTest-470693973 None] Lock "cinder-ad3f9c8d-411d-4fc9-b07d-81c2109d66f5-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:39 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec 1073741824 Jul 28 14:34:39 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:40 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec 1073741824" returned: 0 in 0.441s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:40 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec Jul 28 14:34:40 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:40 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8093bbb-8b1a-4c96-b4b4-256a7c18fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be12ed09-acdd-4aa2-949b-602f9480b0ec', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647e1492-0535-4256-b395-548c2747d476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Volume volume-be12ed09-acdd-4aa2-949b-602f9480b0ec (be12ed09-acdd-4aa2-949b-602f9480b0ec): created successfully Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647e1492-0535-4256-b395-548c2747d476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Flow 'volume_create_manager' (63e83cca-c398-425a-8461-0db010e30bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0285b5b7-5a1a-47d7-a640-5d33145ba1fb tempest-VolumeQuotasAdminTestJSON-443459426 None] Created volume successfully. Jul 28 14:34:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-46aec0ca-ec7b-499f-acf8-499189971962 tempest-VolumeQuotasAdminTestJSON-599553022 None] Transfer volume completed successfully. Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Acquiring lock "cinder-be12ed09-acdd-4aa2-949b-602f9480b0ec-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "cinder-be12ed09-acdd-4aa2-949b-602f9480b0ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Acquiring lock "cinder-quobyte-be12ed09-acdd-4aa2-949b-602f9480b0ec" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "cinder-quobyte-be12ed09-acdd-4aa2-949b-602f9480b0ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d30da2-8840-46f7-a16b-d5ba738e0a28]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:43 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec Jul 28 14:34:43 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:43 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec" returned: 0 in 0.478s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:43 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec Jul 28 14:34:43 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:43 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be12ed09-acdd-4aa2-949b-602f9480b0ec" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "cinder-quobyte-be12ed09-acdd-4aa2-949b-602f9480b0ec" released by "delete_volume" :: held 0.821s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Created reservations ['c29836f8-b795-46bd-a0e4-f011f8a593cb', 'c3f4ccb7-9caf-428e-852d-08be6152a356', '7820ec9b-4a11-48f7-961c-771d73e57623', '555ebf28-ed31-46dc-b37d-7d3e128caf4c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:44 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:44 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:44 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:44 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Deleted volume successfully. Jul 28 14:34:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d77f5b9-0a76-4da0-ac20-162f15b34c1a tempest-VolumeQuotasAdminTestJSON-875146997 None] Lock "cinder-be12ed09-acdd-4aa2-949b-602f9480b0ec-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:49 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:49 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:49 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.498s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:34:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (ea6e5534-23fd-4e3e-a484-3f18eecb1e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828d4460-c8c0-4a95-977d-f14b0c66658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828d4460-c8c0-4a95-977d-f14b0c66658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-584071701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbe9621-673a-4320-ba2e-d9d5ff623a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:53Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3df2d09-d9cb-46c1-ac86-0f6ca15d60d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3df2d09-d9cb-46c1-ac86-0f6ca15d60d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60774b86-d092-4eeb-b6fd-02147821076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60774b86-d092-4eeb-b6fd-02147821076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbe9621-673a-4320-ba2e-d9d5ff623a68', 'volume_name': 'volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd8685-a32e-40d8-bfd3-461419f79543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcd8685-a32e-40d8-bfd3-461419f79543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e06a0-66d9-4235-a7ff-f135cc1144ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:52 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Volume 4fbe9621-673a-4320-ba2e-d9d5ff623a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68', 'volume_size': 1} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-584071701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbe9621-673a-4320-ba2e-d9d5ff623a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:53Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Creating volume 4fbe9621-673a-4320-ba2e-d9d5ff623a68 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:52 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:52 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 1073741824 Jul 28 14:34:52 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:53 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 1073741824" returned: 0 in 0.606s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:53 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 Jul 28 14:34:53 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:53 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68" returned: 0 in 0.319s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e06a0-66d9-4235-a7ff-f135cc1144ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe06cc-9208-4221-98d9-0d88d06542e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Volume volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 (4fbe9621-673a-4320-ba2e-d9d5ff623a68): created successfully Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe06cc-9208-4221-98d9-0d88d06542e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (ea6e5534-23fd-4e3e-a484-3f18eecb1e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-63ad017f-dd67-41f0-9f50-2de7453a758f tempest-VolumesListAdminTestJSON-1391314150 None] Created volume successfully. Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (89a63e4a-ed82-4b44-a90a-4697034f43ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4b755e-7a13-45dc-ad31-189f60d99382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4b755e-7a13-45dc-ad31-189f60d99382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-674384047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32edcea1-fade-4c81-a169-46e3a0a03206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:55Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1cabfd-9883-47fb-9b36-da40fcf09c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1cabfd-9883-47fb-9b36-da40fcf09c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179a25f9-0c2b-4dce-bcd8-4ff97c97e0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (179a25f9-0c2b-4dce-bcd8-4ff97c97e0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32edcea1-fade-4c81-a169-46e3a0a03206', 'volume_name': 'volume-32edcea1-fade-4c81-a169-46e3a0a03206', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c6c03e-547f-4cc2-ad4f-ed6a4447357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c6c03e-547f-4cc2-ad4f-ed6a4447357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c1e240-5ac1-4f15-8c64-0d3157983ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:55 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Volume 32edcea1-fade-4c81-a169-46e3a0a03206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32edcea1-fade-4c81-a169-46e3a0a03206', 'volume_size': 1} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-674384047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32edcea1-fade-4c81-a169-46e3a0a03206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:55Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Creating volume 32edcea1-fade-4c81-a169-46e3a0a03206 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:55 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:55 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 1073741824 Jul 28 14:34:55 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:55 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 1073741824" returned: 0 in 0.484s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:55 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 Jul 28 14:34:55 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:56 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c1e240-5ac1-4f15-8c64-0d3157983ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32edcea1-fade-4c81-a169-46e3a0a03206', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6184e5f6-bdba-4e5a-a883-a098ea12be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Volume volume-32edcea1-fade-4c81-a169-46e3a0a03206 (32edcea1-fade-4c81-a169-46e3a0a03206): created successfully Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6184e5f6-bdba-4e5a-a883-a098ea12be81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (89a63e4a-ed82-4b44-a90a-4697034f43ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-715d66ab-f077-4104-91c6-551ac3343d4c tempest-VolumesListAdminTestJSON-1391314150 None] Created volume successfully. Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Flow 'volume_create_manager' (f9dacda5-5958-4913-a4c4-db5cecbe10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf020c7-9a72-4c43-813a-5b547ed54d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf020c7-9a72-4c43-813a-5b547ed54d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1002168129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57426e6c-792f-4cfa-ba00-494c387680f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6597e1d7d2d4e918bacc840ce66d3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:57Z,use_quota=True,user_id='35a2b42f68064e37bb2576c69189a113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1883195d-8593-4628-aa43-9a228c32b274),volume_type_id=1883195d-8593-4628-aa43-9a228c32b274)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633e3d5-21e6-478c-835c-36c6237a85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633e3d5-21e6-478c-835c-36c6237a85d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7de943-fd55-4b06-9164-54ba35418e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7de943-fd55-4b06-9164-54ba35418e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57426e6c-792f-4cfa-ba00-494c387680f7', 'volume_name': 'volume-57426e6c-792f-4cfa-ba00-494c387680f7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b14a3-afae-45ad-a12a-842fa8948d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9b14a3-afae-45ad-a12a-842fa8948d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbc0969-e474-45e9-ab7e-6c4ec1448fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Volume 57426e6c-792f-4cfa-ba00-494c387680f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57426e6c-792f-4cfa-ba00-494c387680f7', 'volume_size': 1} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1002168129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57426e6c-792f-4cfa-ba00-494c387680f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6597e1d7d2d4e918bacc840ce66d3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:57Z,use_quota=True,user_id='35a2b42f68064e37bb2576c69189a113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1883195d-8593-4628-aa43-9a228c32b274),volume_type_id=1883195d-8593-4628-aa43-9a228c32b274)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Creating volume 57426e6c-792f-4cfa-ba00-494c387680f7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:57 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:57 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 1073741824 Jul 28 14:34:57 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:58 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 1073741824" returned: 0 in 0.631s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:58 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 Jul 28 14:34:58 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (06482d39-d564-43fb-9f5b-0ef5a465fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e80438-de4b-411b-bdf5-27414c057656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e80438-de4b-411b-bdf5-27414c057656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316809545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977072a2-d9d4-4898-ac1f-bec5a5ba5312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:58Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5f3878-cb1c-482a-8c7c-ce80c9b5bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5f3878-cb1c-482a-8c7c-ce80c9b5bb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb116842-365b-412b-a530-6ef0b6adc32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb116842-365b-412b-a530-6ef0b6adc32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977072a2-d9d4-4898-ac1f-bec5a5ba5312', 'volume_name': 'volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede379d-f466-4847-8259-5caa5743a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede379d-f466-4847-8259-5caa5743a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830fd047-6aa0-45d0-9d12-5035f9892dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Volume 977072a2-d9d4-4898-ac1f-bec5a5ba5312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312', 'volume_size': 1} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:58 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316809545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=977072a2-d9d4-4898-ac1f-bec5a5ba5312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3afc5adb851744f38c587a3b89e79cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:34:58Z,use_quota=True,user_id='cd940a4039ff4f7a9d2dff57d6c2bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Creating volume 977072a2-d9d4-4898-ac1f-bec5a5ba5312 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:34:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbc0969-e474-45e9-ab7e-6c4ec1448fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57426e6c-792f-4cfa-ba00-494c387680f7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 1073741824 Jul 28 14:34:58 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f7fc2b-3253-46ab-bd6e-918300aab7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Volume volume-57426e6c-792f-4cfa-ba00-494c387680f7 (57426e6c-792f-4cfa-ba00-494c387680f7): created successfully Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87f7fc2b-3253-46ab-bd6e-918300aab7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Flow 'volume_create_manager' (f9dacda5-5958-4913-a4c4-db5cecbe10b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d87cdbad-c9d2-449f-a179-0694e705c1da tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Created volume successfully. Jul 28 14:34:58 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 1073741824" returned: 0 in 0.530s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:59 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 Jul 28 14:34:59 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:34:59 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312" returned: 0 in 0.247s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830fd047-6aa0-45d0-9d12-5035f9892dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b32f80-1736-487c-97b9-dd8c3701cd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:34:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Volume volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 (977072a2-d9d4-4898-ac1f-bec5a5ba5312): created successfully Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b32f80-1736-487c-97b9-dd8c3701cd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Flow 'volume_create_manager' (06482d39-d564-43fb-9f5b-0ef5a465fa01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:34:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-93cb76e0-ebc7-4de5-8bcb-aec66ecc2459 tempest-VolumesListAdminTestJSON-1391314150 None] Created volume successfully. Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:34:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:34:59 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:34:59 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:00 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:00 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:00 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6f9bb050-06c8-4257-8eca-337a2cd40e52 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Retype volume completed successfully. Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "cinder-57426e6c-792f-4cfa-ba00-494c387680f7-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "cinder-57426e6c-792f-4cfa-ba00-494c387680f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "cinder-quobyte-57426e6c-792f-4cfa-ba00-494c387680f7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "cinder-quobyte-57426e6c-792f-4cfa-ba00-494c387680f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fee36d-34d1-48ca-a3c8-6830ec7b223c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:01 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 Jul 28 14:35:01 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Flow 'volume_create_manager' (1094494b-f527-42ea-82d8-6a9499778c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f904ac06-c1d9-4a98-9172-92c79f2e3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f904ac06-c1d9-4a98-9172-92c79f2e3844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff34c68-5388-4be4-8012-13f6dda1bae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced25c2c2e234364a5d6907e6c655c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:01Z,use_quota=True,user_id='3190bcbb614347b4b35a2bb454c456fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1f8f72-c24d-49dd-9d56-22356de93a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1f8f72-c24d-49dd-9d56-22356de93a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7de24e-fd22-4cb4-8a18-79325746d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7de24e-fd22-4cb4-8a18-79325746d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff34c68-5388-4be4-8012-13f6dda1bae1', 'volume_name': 'volume-9ff34c68-5388-4be4-8012-13f6dda1bae1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187f5eaa-9bd8-4de0-af89-9b1a9cdf5c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187f5eaa-9bd8-4de0-af89-9b1a9cdf5c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d624d10f-4ca3-46d6-970e-3b5a680f6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:01 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Volume 9ff34c68-5388-4be4-8012-13f6dda1bae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff34c68-5388-4be4-8012-13f6dda1bae1', 'volume_size': 1} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff34c68-5388-4be4-8012-13f6dda1bae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced25c2c2e234364a5d6907e6c655c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:01Z,use_quota=True,user_id='3190bcbb614347b4b35a2bb454c456fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Creating volume 9ff34c68-5388-4be4-8012-13f6dda1bae1 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:01 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:01 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 1073741824 Jul 28 14:35:01 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:01 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7" returned: 0 in 0.443s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:01 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7 Jul 28 14:35:01 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:02 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-57426e6c-792f-4cfa-ba00-494c387680f7" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "cinder-quobyte-57426e6c-792f-4cfa-ba00-494c387680f7" released by "delete_volume" :: held 0.788s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:02 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:02 devstack cinder-volume[87385]: WARNING cinder.quota [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:35:02 devstack cinder-volume[87385]: WARNING cinder.quota [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 1073741824" returned: 0 in 0.544s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Created reservations ['d7befe4d-6e26-4951-9d45-800df35bbd48', '6af72ca7-56f1-4518-a2ca-672491e2b0ca', '91a239ec-050d-4c0d-9f68-8bd00c7c81e9', 'fa55da7f-7292-4629-b67d-6c22de65292b'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:02 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 Jul 28 14:35:02 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:02 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:02 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:02 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:02 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.336s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Deleted volume successfully. Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d624d10f-4ca3-46d6-970e-3b5a680f6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff34c68-5388-4be4-8012-13f6dda1bae1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9872908-c9e3-425a-804c-9f5a6a85ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-eba99e78-2b52-4dd6-9fcf-d6006837a3e3 tempest-VolumeRetypeWithoutMigrationTest-1405128995 None] Lock "cinder-57426e6c-792f-4cfa-ba00-494c387680f7-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Volume volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 (9ff34c68-5388-4be4-8012-13f6dda1bae1): created successfully Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9872908-c9e3-425a-804c-9f5a6a85ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Flow 'volume_create_manager' (1094494b-f527-42ea-82d8-6a9499778c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2aa0efd8-9c87-4f30-8a9e-704a374ef48b tempest-VolumesListAdminTestJSON-121310926 None] Created volume successfully. Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Acquiring lock "cinder-9ff34c68-5388-4be4-8012-13f6dda1bae1-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "cinder-9ff34c68-5388-4be4-8012-13f6dda1bae1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Acquiring lock "cinder-quobyte-9ff34c68-5388-4be4-8012-13f6dda1bae1" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "cinder-quobyte-9ff34c68-5388-4be4-8012-13f6dda1bae1" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4877cd6-f6a8-41ed-b947-d62370d890b9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-977072a2-d9d4-4898-ac1f-bec5a5ba5312-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-977072a2-d9d4-4898-ac1f-bec5a5ba5312-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-quobyte-977072a2-d9d4-4898-ac1f-bec5a5ba5312" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-977072a2-d9d4-4898-ac1f-bec5a5ba5312" acquired by "delete_volume" :: waited 0.041s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:03 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 Jul 28 14:35:03 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea1e684-26e8-4c96-9bb5-c086dec5fe87]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:04 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 Jul 28 14:35:04 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:04 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1" returned: 0 in 0.711s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:04 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1 Jul 28 14:35:04 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:04 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312" returned: 0 in 0.725s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:04 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312 Jul 28 14:35:04 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:04 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9ff34c68-5388-4be4-8012-13f6dda1bae1" returned: 0 in 0.557s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "cinder-quobyte-9ff34c68-5388-4be4-8012-13f6dda1bae1" released by "delete_volume" :: held 1.353s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:INSERT=45,cinder:UPDATE=183,cinder:SELECT=162,cinder:DELETE=14 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=155,cinder:INSERT=56,cinder:UPDATE=182,cinder:DELETE=14 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:35:05 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-977072a2-d9d4-4898-ac1f-bec5a5ba5312" returned: 0 in 0.421s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-977072a2-d9d4-4898-ac1f-bec5a5ba5312" released by "delete_volume" :: held 1.229s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Created reservations ['cf2f686f-e7f8-4741-a45b-13b72613525f', '73165c60-da0a-4469-afa4-9d3bde7c3174', '956eb32a-99ee-43c7-a621-cb6b06fbdd82', 'c60449b8-caac-4f5d-a473-516fee479ef5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:05 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:05 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Created reservations ['c518cc88-1fe1-4fe5-aa02-4a82b1dfb25f', 'b290a7df-0137-4299-95ca-525504a83185', '4370442c-b847-4698-8089-97cb9f90a7dd', '08358a81-fac6-40ab-8ed4-b5b1f2137884'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:05 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:05 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:05 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Deleted volume successfully. Jul 28 14:35:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-78780cba-a23e-4dbf-9c30-acb94cc95670 tempest-VolumesListAdminTestJSON-121310926 None] Lock "cinder-9ff34c68-5388-4be4-8012-13f6dda1bae1-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:06 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.422s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Deleted volume successfully. Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-789d4640-457a-43a4-ae9d-22eb6b79fd02 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-977072a2-d9d4-4898-ac1f-bec5a5ba5312-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-32edcea1-fade-4c81-a169-46e3a0a03206-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-32edcea1-fade-4c81-a169-46e3a0a03206-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-quobyte-32edcea1-fade-4c81-a169-46e3a0a03206" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-32edcea1-fade-4c81-a169-46e3a0a03206" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccba44fc-8e11-4013-b791-127b0f341c47]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:06 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 Jul 28 14:35:06 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:06 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206" returned: 0 in 0.519s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:06 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206 Jul 28 14:35:06 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:07 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-32edcea1-fade-4c81-a169-46e3a0a03206" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-32edcea1-fade-4c81-a169-46e3a0a03206" released by "delete_volume" :: held 0.952s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Created reservations ['47d269e1-669d-4abe-bd5c-482fbbad40b1', '8bd75478-961b-48ff-b22f-8754a24f79f4', '82805d8c-9eeb-4422-866a-622cbf2ca944', '6cf6165e-88a3-41df-bd31-0c55a929ad4c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:07 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:07 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:07 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Deleted volume successfully. Jul 28 14:35:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c87a36fa-96d4-4252-bc42-2d63fbf6c221 tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-32edcea1-fade-4c81-a169-46e3a0a03206-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-4fbe9621-673a-4320-ba2e-d9d5ff623a68-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-4fbe9621-673a-4320-ba2e-d9d5ff623a68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "cinder-quobyte-4fbe9621-673a-4320-ba2e-d9d5ff623a68" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-4fbe9621-673a-4320-ba2e-d9d5ff623a68" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52b9699-129b-48b6-a80e-966e627db76c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:08 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 Jul 28 14:35:08 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:09 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68" returned: 0 in 0.402s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:09 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68 Jul 28 14:35:09 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:09 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fbe9621-673a-4320-ba2e-d9d5ff623a68" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-quobyte-4fbe9621-673a-4320-ba2e-d9d5ff623a68" released by "delete_volume" :: held 0.714s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Created reservations ['46a7a27b-e87a-4b0d-b788-d72c4464811f', '936da389-0fe3-4017-85cd-48030d9215ee', '85dbc31a-abd0-4df2-97d4-e4af606be611', '1cb7447b-1fa9-4426-a0b6-095952e8d0ed'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:09 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:09 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:09 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Deleted volume successfully. Jul 28 14:35:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-baaa6fb5-11d2-4f2c-8c5c-0e4bf8cc0a0c tempest-VolumesListAdminTestJSON-1391314150 None] Lock "cinder-4fbe9621-673a-4320-ba2e-d9d5ff623a68-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Flow 'volume_create_manager' (94ef0d53-4b96-4967-a8e6-f4bb9deef247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d4de98-5ae4-4e66-8c2e-8e2db782e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d4de98-5ae4-4e66-8c2e-8e2db782e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1196162848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3ca842-3fba-4185-8822-4e503cf8c97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1bf35c7e054dc68689151cd1e4726d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:18Z,use_quota=True,user_id='913b95291e924335a26dcffd51b0fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4841365c-2906-4f00-b326-c58dfe6bb822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4841365c-2906-4f00-b326-c58dfe6bb822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672efe3-97b0-44d7-9762-530223b73a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0672efe3-97b0-44d7-9762-530223b73a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3ca842-3fba-4185-8822-4e503cf8c97b', 'volume_name': 'volume-aa3ca842-3fba-4185-8822-4e503cf8c97b', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b572d95f-4026-400a-9c6d-467f3be8eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b572d95f-4026-400a-9c6d-467f3be8eac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa42671-c7b4-434c-beab-aacfaf3d02be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:17 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Volume aa3ca842-3fba-4185-8822-4e503cf8c97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3ca842-3fba-4185-8822-4e503cf8c97b', 'volume_size': 1} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1196162848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3ca842-3fba-4185-8822-4e503cf8c97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1bf35c7e054dc68689151cd1e4726d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:18Z,use_quota=True,user_id='913b95291e924335a26dcffd51b0fb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Creating volume aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:17 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:17 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b 1073741824 Jul 28 14:35:17 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:18 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b 1073741824" returned: 0 in 0.440s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:18 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b Jul 28 14:35:18 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:18 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa42671-c7b4-434c-beab-aacfaf3d02be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3ca842-3fba-4185-8822-4e503cf8c97b', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd33b1-1390-44f0-89b2-ae1f70a25090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:18 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Volume volume-aa3ca842-3fba-4185-8822-4e503cf8c97b (aa3ca842-3fba-4185-8822-4e503cf8c97b): created successfully Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fd33b1-1390-44f0-89b2-ae1f70a25090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Flow 'volume_create_manager' (94ef0d53-4b96-4967-a8e6-f4bb9deef247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:18 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2d509cec-3875-4dc6-b1d0-38956505ea2f tempest-SnapshotMetadataTestJSON-209573299 None] Created volume successfully. Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Creating offline snapshot d9dfa5c7-3e30-43c3-9b55-3121c11ad22f of volume aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84dd2c-5f0c-48ac-975b-a2d4e8254585]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:18 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b Jul 28 14:35:18 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:19 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b" returned: 0 in 0.383s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:19 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f 1G Jul 28 14:35:19 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:19 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f 1G" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ca842-3fba-4185-8822-4e503cf8c97b -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:19 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ca842-3fba-4185-8822-4e503cf8c97b -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f Jul 28 14:35:19 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:19 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ca842-3fba-4185-8822-4e503cf8c97b -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" returned: 0 in 0.338s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:19 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f is being set with open permissions: ugo+rw Jul 28 14:35:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:19 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f Jul 28 14:35:19 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:20 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:20 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info Jul 28 14:35:20 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:20 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:20 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info is being set with open permissions: ugo+rw Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:20 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info Jul 28 14:35:20 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:20 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.info" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8dff1504-c357-401d-b2f9-ad2546712fb5 tempest-SnapshotMetadataTestJSON-209573299 None] Create snapshot completed successfully Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "cinder-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "cinder-quobyte-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Deleting offline snapshot d9dfa5c7-3e30-43c3-9b55-3121c11ad22f of volume aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] snapshot_file for this snap is: volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb10b6-7af0-4a37-96f5-e10aaf0c27dc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:22 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f Jul 28 14:35:22 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:23 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa3ca842-3fba-4185-8822-4e503cf8c97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[526a5af9-0f51-4c26-81a9-3fa9c93d862b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:23 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b Jul 28 14:35:23 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:23 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b" returned: 0 in 0.410s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:23 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f Jul 28 14:35:23 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:24 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" returned: 0 in 0.453s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:24 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f Jul 28 14:35:24 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:24 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b.d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f" released by "_delete_snapshot" :: held 1.683s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" released by "delete_snapshot" :: held 1.708s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Created reservations ['d7433780-571f-4135-ac8a-ce177362ab32', 'c1e7f2fb-f4b1-4c2b-b15b-7da6b87b9475', 'ca8306d2-6660-4393-9e87-9b8dc90ea289', '880f0ee8-27cf-4ec7-8fb2-54e4a0e6ab20'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Delete snapshot completed successfully. Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c822822b-285f-4206-973b-7c465b2a90d7 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-d9dfa5c7-3e30-43c3-9b55-3121c11ad22f-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "cinder-aa3ca842-3fba-4185-8822-4e503cf8c97b-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-aa3ca842-3fba-4185-8822-4e503cf8c97b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad24133a-dfa1-4d19-9067-f12e214ba5e5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:25 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b Jul 28 14:35:25 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:25 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:25 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b Jul 28 14:35:25 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:25 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aa3ca842-3fba-4185-8822-4e503cf8c97b" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-quobyte-aa3ca842-3fba-4185-8822-4e503cf8c97b" released by "delete_volume" :: held 0.744s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Created reservations ['a1919ae6-d8e4-4ea9-9906-76bea12c5d84', '2679bd3f-e5ea-453c-95f0-bf309f608d5e', '3db19e05-2688-4225-b007-a3a29439bcad', '616d2d4c-b236-424f-ad2d-e621c7d57a35'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:25 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:25 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:26 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.304s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:26 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Deleted volume successfully. Jul 28 14:35:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-64ab9bcd-3ddc-4d3e-b521-1a67d083d000 tempest-SnapshotMetadataTestJSON-209573299 None] Lock "cinder-aa3ca842-3fba-4185-8822-4e503cf8c97b-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Flow 'volume_create_manager' (c63675a4-78b7-4d73-8355-6e8547559a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4a6fc-cebf-42af-a993-7ff1131c60d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df4a6fc-cebf-42af-a993-7ff1131c60d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1083815459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d5c59a-7537-46fc-96aa-47592b6f5411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f603f3416cfa4639a0e237709de42fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:28Z,use_quota=True,user_id='3414fbc3561a424e9dcfc55ccc963e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42037022-b65e-49b2-80cc-66545a71435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42037022-b65e-49b2-80cc-66545a71435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6588c3a3-a6de-4a8d-b6e3-b3115d8df364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6588c3a3-a6de-4a8d-b6e3-b3115d8df364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d5c59a-7537-46fc-96aa-47592b6f5411', 'volume_name': 'volume-c0d5c59a-7537-46fc-96aa-47592b6f5411', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab46370-6dfe-4cdb-82a1-26739439560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab46370-6dfe-4cdb-82a1-26739439560a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13d88d-c9c9-4b5f-a9f6-77e7c0a61a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Volume c0d5c59a-7537-46fc-96aa-47592b6f5411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d5c59a-7537-46fc-96aa-47592b6f5411', 'volume_size': 1} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1083815459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d5c59a-7537-46fc-96aa-47592b6f5411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f603f3416cfa4639a0e237709de42fe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:28Z,use_quota=True,user_id='3414fbc3561a424e9dcfc55ccc963e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Creating volume c0d5c59a-7537-46fc-96aa-47592b6f5411 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:28 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:28 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 1073741824 Jul 28 14:35:28 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:29 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 1073741824" returned: 0 in 0.586s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:29 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 Jul 28 14:35:29 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:29 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411" returned: 0 in 0.327s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13d88d-c9c9-4b5f-a9f6-77e7c0a61a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d5c59a-7537-46fc-96aa-47592b6f5411', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86adaebb-36ca-4dc0-a470-870268df95c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Volume volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 (c0d5c59a-7537-46fc-96aa-47592b6f5411): created successfully Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86adaebb-36ca-4dc0-a470-870268df95c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Flow 'volume_create_manager' (c63675a4-78b7-4d73-8355-6e8547559a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-5ef40fce-fc41-453e-b89d-3def09f83324 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Created volume successfully. Jul 28 14:35:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-27d0517a-abbc-452c-ab83-db98e99b5c3c req-59ae2312-6d8b-4a8a-9fc8-2d40910a4cd8 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-27d0517a-abbc-452c-ab83-db98e99b5c3c req-59ae2312-6d8b-4a8a-9fc8-2d40910a4cd8 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-27d0517a-abbc-452c-ab83-db98e99b5c3c req-59ae2312-6d8b-4a8a-9fc8-2d40910a4cd8 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-27d0517a-abbc-452c-ab83-db98e99b5c3c req-59ae2312-6d8b-4a8a-9fc8-2d40910a4cd8 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-c0d5c59a-7537-46fc-96aa-47592b6f5411', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b40248af-40ff-473c-98db-d1bf9b565235', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:35:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-27d0517a-abbc-452c-ab83-db98e99b5c3c req-59ae2312-6d8b-4a8a-9fc8-2d40910a4cd8 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] attachment_update completed successfully. Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Flow 'volume_create_manager' (faf1f759-5102-48ca-9ab3-c12605ccd4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c474d7-f328-4498-9f52-fa28ce804404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c474d7-f328-4498-9f52-fa28ce804404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1043007530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cc77d-5edb-4136-a316-3c5769bc6b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6167948a517a4a39ae45a529cd157ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:34Z,use_quota=True,user_id='94192c8ebae84534b00714972df7a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aed6dbc-b414-483a-9a85-ca72d7307b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aed6dbc-b414-483a-9a85-ca72d7307b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535aab9e-e1dd-4426-957b-b1a27b09db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535aab9e-e1dd-4426-957b-b1a27b09db8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8cc77d-5edb-4136-a316-3c5769bc6b5a', 'volume_name': 'volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84192ca-ebe3-4f6f-abbe-d68f896e788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84192ca-ebe3-4f6f-abbe-d68f896e788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ff0535-7b6d-4849-8221-067e1e8c63ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:34 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Volume 9e8cc77d-5edb-4136-a316-3c5769bc6b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a', 'volume_size': 1} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1043007530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8cc77d-5edb-4136-a316-3c5769bc6b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6167948a517a4a39ae45a529cd157ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:34Z,use_quota=True,user_id='94192c8ebae84534b00714972df7a391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Creating volume 9e8cc77d-5edb-4136-a316-3c5769bc6b5a {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:34 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:34 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a 1073741824 Jul 28 14:35:34 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:34 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a 1073741824" returned: 0 in 0.667s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:34 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a Jul 28 14:35:34 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:35 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ff0535-7b6d-4849-8221-067e1e8c63ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1750d286-671a-4e79-884e-b0e30b3380c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:35 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Volume volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a (9e8cc77d-5edb-4136-a316-3c5769bc6b5a): created successfully Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1750d286-671a-4e79-884e-b0e30b3380c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Flow 'volume_create_manager' (faf1f759-5102-48ca-9ab3-c12605ccd4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-41018b2f-3d60-454f-ad0e-e852bab55035 tempest-AbsoluteLimitsTests-1072910815 None] Created volume successfully. Jul 28 14:35:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-a5a670e9-a3f4-43f0-9054-8b92aa4da405 req-b8f7b84c-21ab-4609-92ae-eacf65b50b46 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Terminate volume connection completed successfully. Jul 28 14:35:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-a5a670e9-a3f4-43f0-9054-8b92aa4da405 req-b8f7b84c-21ab-4609-92ae-eacf65b50b46 tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Deleting attachment b40248af-40ff-473c-98db-d1bf9b565235. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "cinder-c0d5c59a-7537-46fc-96aa-47592b6f5411-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "cinder-c0d5c59a-7537-46fc-96aa-47592b6f5411-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "cinder-quobyte-c0d5c59a-7537-46fc-96aa-47592b6f5411" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "cinder-quobyte-c0d5c59a-7537-46fc-96aa-47592b6f5411" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8a847-6f09-45c0-87c1-8819efe27d57]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:36 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 Jul 28 14:35:36 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Acquiring lock "cinder-9e8cc77d-5edb-4136-a316-3c5769bc6b5a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "cinder-9e8cc77d-5edb-4136-a316-3c5769bc6b5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Acquiring lock "cinder-quobyte-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "cinder-quobyte-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdfd573-cd40-412f-83f6-c7adefd1f13e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:36 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411" returned: 0 in 0.485s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:36 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a Jul 28 14:35:36 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:36 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411 Jul 28 14:35:36 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:36 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" returned: 0 in 0.417s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:36 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c0d5c59a-7537-46fc-96aa-47592b6f5411" returned: 0 in 0.312s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:36 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a Jul 28 14:35:36 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "cinder-quobyte-c0d5c59a-7537-46fc-96aa-47592b6f5411" released by "delete_volume" :: held 0.875s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Created reservations ['d2f66a1e-2667-4208-8a17-b8260dbbc69e', '0a2193aa-b918-42e9-b8b6-3692ca9edfab', '462110db-4fab-416a-bbea-34b0c556308c', 'fb05f539-da2f-405a-893f-f9d4b6716f4d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:37 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:37 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:37 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" returned: 0 in 0.332s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "cinder-quobyte-9e8cc77d-5edb-4136-a316-3c5769bc6b5a" released by "delete_volume" :: held 0.828s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Created reservations ['52dfb164-c60a-49bc-8689-a02ca0b55b25', '26f984c8-8983-4bdf-8fd4-12576f5c1bd0', '397633ca-89f6-40eb-8a81-f00d4d939f86', 'ab3f437f-8e29-44a4-9d6f-733b2fdebfba'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:37 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.371s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:37 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Deleted volume successfully. Jul 28 14:35:37 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-04dfa9d6-7905-4baf-a702-8416482d3caa tempest-TestServerVolumeAttachScenarioOldVersion-220107040 None] Lock "cinder-c0d5c59a-7537-46fc-96aa-47592b6f5411-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.371s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:37 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Deleted volume successfully. Jul 28 14:35:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1fe6531b-dbf5-4d88-9564-ba36f78f4cf4 tempest-AbsoluteLimitsTests-1072910815 None] Lock "cinder-9e8cc77d-5edb-4136-a316-3c5769bc6b5a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:49 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:35:49 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:49 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:35:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:35:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=80,cinder:SELECT=51,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:35:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=59,cinder:INSERT=20,cinder:UPDATE=66,cinder:DELETE=5 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (71b5d86e-2256-4711-b558-a7652e6627e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b78e20f-ca2d-45b8-9493-a49f0dec082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b78e20f-ca2d-45b8-9493-a49f0dec082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145857892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507c0ca-f3e4-401e-9296-cc117eb41afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:55Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f567d48-daf0-4f22-a0cf-9c26057d9e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f567d48-daf0-4f22-a0cf-9c26057d9e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcaad3-24ff-4264-9da7-f2d7de87224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcaad3-24ff-4264-9da7-f2d7de87224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9507c0ca-f3e4-401e-9296-cc117eb41afe', 'volume_name': 'volume-9507c0ca-f3e4-401e-9296-cc117eb41afe', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80f5dfd-f68a-40d7-827b-db0685563ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80f5dfd-f68a-40d7-827b-db0685563ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9e537a-fbff-480b-a585-f6e26e0aa078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:55 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Volume 9507c0ca-f3e4-401e-9296-cc117eb41afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9507c0ca-f3e4-401e-9296-cc117eb41afe', 'volume_size': 1} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145857892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507c0ca-f3e4-401e-9296-cc117eb41afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:55Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Creating volume 9507c0ca-f3e4-401e-9296-cc117eb41afe {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:55 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:55 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe 1073741824 Jul 28 14:35:55 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:56 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe 1073741824" returned: 0 in 0.523s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:56 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe Jul 28 14:35:56 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:56 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe" returned: 0 in 0.417s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (5645cd52-d98f-441c-afa6-2213d5bc08e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f13efd-f015-4a67-a91e-6685c1080bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9e537a-fbff-480b-a585-f6e26e0aa078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9507c0ca-f3e4-401e-9296-cc117eb41afe', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75537ce-1dd1-46d8-ba53-68acacc21cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f13efd-f015-4a67-a91e-6685c1080bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630724375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f4365-c480-458f-b426-f4b7f22d3c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:57Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318a6b99-ad61-481c-8479-502cc87fec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318a6b99-ad61-481c-8479-502cc87fec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce8a2c8-6b23-4b5a-979b-e9c37ce8c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce8a2c8-6b23-4b5a-979b-e9c37ce8c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683f4365-c480-458f-b426-f4b7f22d3c20', 'volume_name': 'volume-683f4365-c480-458f-b426-f4b7f22d3c20', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83835ca1-b285-4526-8752-3d10ba952414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83835ca1-b285-4526-8752-3d10ba952414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da847e12-61aa-4caa-9fc5-bf2a678a9862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Volume 683f4365-c480-458f-b426-f4b7f22d3c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683f4365-c480-458f-b426-f4b7f22d3c20', 'volume_size': 1} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630724375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683f4365-c480-458f-b426-f4b7f22d3c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:35:57Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Creating volume 683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:35:56 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Volume volume-9507c0ca-f3e4-401e-9296-cc117eb41afe (9507c0ca-f3e4-401e-9296-cc117eb41afe): created successfully Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75537ce-1dd1-46d8-ba53-68acacc21cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:56 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 1073741824 Jul 28 14:35:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (71b5d86e-2256-4711-b558-a7652e6627e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:56 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c0ae254a-d0cc-406c-9b38-9d50ac7b8758 tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:35:57 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 1073741824" returned: 0 in 0.493s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:57 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 Jul 28 14:35:57 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3259d0d3-3a04-466a-b230-94b0ad711262 tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe" by "attach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3259d0d3-3a04-466a-b230-94b0ad711262 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe" acquired by "attach_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3259d0d3-3a04-466a-b230-94b0ad711262 tempest-VolumesActionsTest-628251966 None] Attaching volume 9507c0ca-f3e4-401e-9296-cc117eb41afe to instance 8e96f1a3-4c8f-4ec2-aef8-3d15b01aa185 at mountpoint /dev/vdb on host None. Jul 28 14:35:57 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da847e12-61aa-4caa-9fc5-bf2a678a9862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683f4365-c480-458f-b426-f4b7f22d3c20', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d6fe9b-9941-4e0c-a8f1-1d0e266299f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:35:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3259d0d3-3a04-466a-b230-94b0ad711262 tempest-VolumesActionsTest-628251966 None] Attach volume completed successfully. Jul 28 14:35:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Volume volume-683f4365-c480-458f-b426-f4b7f22d3c20 (683f4365-c480-458f-b426-f4b7f22d3c20): created successfully Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d6fe9b-9941-4e0c-a8f1-1d0e266299f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (5645cd52-d98f-441c-afa6-2213d5bc08e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:35:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3259d0d3-3a04-466a-b230-94b0ad711262 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe" released by "attach_volume" :: held 0.180s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-58ca8627-0027-4312-843e-420dcf0e9cf4 tempest-VolumesSnapshotTestJSON-630951326 None] Created volume successfully. Jul 28 14:35:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Terminate volume connection completed successfully. Jul 28 14:35:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" by "detach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Detaching volume 9507c0ca-f3e4-401e-9296-cc117eb41afe from instance 8e96f1a3-4c8f-4ec2-aef8-3d15b01aa185. Jul 28 14:35:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Detach volume completed successfully. Jul 28 14:35:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cb59096b-70f5-40f1-ae79-c0ee59bcc468 tempest-VolumesActionsTest-63932526 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df730c48-8e79-4309-854b-3a27f4ffa8d5 tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" by "detach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df730c48-8e79-4309-854b-3a27f4ffa8d5 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-df730c48-8e79-4309-854b-3a27f4ffa8d5 tempest-VolumesActionsTest-628251966 None] Volume detach called, but volume not attached. Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df730c48-8e79-4309-854b-3a27f4ffa8d5 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Creating offline snapshot 5f22caf7-5581-4383-b26a-e99f354b51ed of volume 683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1f55f-318f-46ce-9410-7cc5ac99f94e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:59 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 Jul 28 14:35:59 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-quobyte-9507c0ca-f3e4-401e-9296-cc117eb41afe" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "cinder-quobyte-9507c0ca-f3e4-401e-9296-cc117eb41afe" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a1ddb-ae2b-4006-ac09-8eca4a64bb72]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:59 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe Jul 28 14:35:59 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:59 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:59 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed 1G Jul 28 14:35:59 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:35:59 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe" returned: 0 in 0.457s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:35:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:35:59 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe Jul 28 14:35:59 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:00 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed 1G" returned: 0 in 0.500s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683f4365-c480-458f-b426-f4b7f22d3c20 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:00 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-9507c0ca-f3e4-401e-9296-cc117eb41afe" returned: 0 in 0.381s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:00 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683f4365-c480-458f-b426-f4b7f22d3c20 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed Jul 28 14:36:00 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "cinder-quobyte-9507c0ca-f3e4-401e-9296-cc117eb41afe" released by "delete_volume" :: held 0.899s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Created reservations ['665e5b78-bbcd-4977-9e01-5bcd0c9305ad', 'cb39fc17-7c77-4092-b932-b78345014495', '88ba80bd-2b3e-4d84-9236-4e68d39fe8a4', '08386cc5-f558-40fd-9895-2f3c8740fe21'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:00 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:00 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:00 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683f4365-c480-458f-b426-f4b7f22d3c20 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed" returned: 0 in 0.679s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:00 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed is being set with open permissions: ugo+rw Jul 28 14:36:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:00 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed Jul 28 14:36:00 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:01 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.477s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Deleted volume successfully. Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-92d27028-7369-47c4-814b-3fe5ff38bea7 tempest-VolumesActionsTest-628251966 None] Lock "cinder-9507c0ca-f3e4-401e-9296-cc117eb41afe-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:01 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:01 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info Jul 28 14:36:01 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:01 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info" returned: 0 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:01 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info is being set with open permissions: ugo+rw Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:01 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info Jul 28 14:36:01 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:01 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.info" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b5587a3f-c36f-4bae-96d1-dc5ffc13532c tempest-VolumesSnapshotTestJSON-630951326 None] Create snapshot completed successfully Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-5f22caf7-5581-4383-b26a-e99f354b51ed-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-5f22caf7-5581-4383-b26a-e99f354b51ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-5f22caf7-5581-4383-b26a-e99f354b51ed" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-5f22caf7-5581-4383-b26a-e99f354b51ed" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Deleting offline snapshot 5f22caf7-5581-4383-b26a-e99f354b51ed of volume 683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] snapshot_file for this snap is: volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f8624-2ead-4d43-8ac3-5d21c4ac1a1e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:02 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed Jul 28 14:36:02 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:03 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed" returned: 0 in 0.530s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-683f4365-c480-458f-b426-f4b7f22d3c20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc86b8-8068-448f-b2fb-84685f11da0b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:03 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 Jul 28 14:36:03 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:03 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20" returned: 0 in 0.547s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:03 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed Jul 28 14:36:03 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:04 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed" returned: 0 in 0.460s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:04 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed Jul 28 14:36:04 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:04 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20.5f22caf7-5581-4383-b26a-e99f354b51ed" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-5f22caf7-5581-4383-b26a-e99f354b51ed" released by "_delete_snapshot" :: held 1.976s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" released by "delete_snapshot" :: held 2.009s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['d3bed87d-fb6a-4b6b-b6e3-47ee5ae6066d', '32b756d1-db9f-40bb-af90-8445e310d761', 'd2ef46b6-864d-4939-b79b-694f8db0918e', '98ef8c66-032f-45b2-8179-82ad3ba83c80'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Delete snapshot completed successfully. Jul 28 14:36:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ceca0531-bc11-477c-aa97-923d1235c458 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-5f22caf7-5581-4383-b26a-e99f354b51ed-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (563ab306-849a-4406-9f73-5dc2483769c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6313f2cb-bdfa-4c8a-89e1-b35e4e1877e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6313f2cb-bdfa-4c8a-89e1-b35e4e1877e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992420238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badcd1ae-6d96-48e7-bf85-1c35d51737fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:05Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d190c88-8305-4ceb-9913-c70f8e8d330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d190c88-8305-4ceb-9913-c70f8e8d330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f2694a-d0e3-4c5c-8ce6-8cac3d184b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f2694a-d0e3-4c5c-8ce6-8cac3d184b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badcd1ae-6d96-48e7-bf85-1c35d51737fc', 'volume_name': 'volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37faf9c-aafd-4d8f-b19d-a51d287d16e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37faf9c-aafd-4d8f-b19d-a51d287d16e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa85a8-5548-44ca-9b1b-e6355b2d89f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Volume badcd1ae-6d96-48e7-bf85-1c35d51737fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc', 'volume_size': 1} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992420238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badcd1ae-6d96-48e7-bf85-1c35d51737fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:05Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Creating volume badcd1ae-6d96-48e7-bf85-1c35d51737fc {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:05 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:05 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc 1073741824 Jul 28 14:36:05 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:06 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc 1073741824" returned: 0 in 0.555s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:06 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc Jul 28 14:36:06 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (7e5013c7-286e-4f0f-a123-602b58bb2cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330cb9a5-1293-40a9-a98e-5ebbc524f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330cb9a5-1293-40a9-a98e-5ebbc524f468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960355626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd43905a-2246-45c0-800e-59a07fb51071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:06Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3279fc18-98a3-4e5d-af45-5799eafa1816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3279fc18-98a3-4e5d-af45-5799eafa1816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5454e5bd-07ec-472b-9cd8-80958305cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5454e5bd-07ec-472b-9cd8-80958305cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd43905a-2246-45c0-800e-59a07fb51071', 'volume_name': 'volume-cd43905a-2246-45c0-800e-59a07fb51071', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b1851-0199-4d84-bc68-1250391a115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b1851-0199-4d84-bc68-1250391a115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4115b220-ec6d-42a8-adca-f8607be98892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Volume cd43905a-2246-45c0-800e-59a07fb51071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd43905a-2246-45c0-800e-59a07fb51071', 'volume_size': 1} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc" returned: 0 in 0.334s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960355626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd43905a-2246-45c0-800e-59a07fb51071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:06Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Creating volume cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:06 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afa85a8-5548-44ca-9b1b-e6355b2d89f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5287f673-8ef0-437a-89d4-6223949b0038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:06 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 1073741824 Jul 28 14:36:06 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Volume volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc (badcd1ae-6d96-48e7-bf85-1c35d51737fc): created successfully Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5287f673-8ef0-437a-89d4-6223949b0038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (563ab306-849a-4406-9f73-5dc2483769c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-23781b1a-1cf0-401c-8f03-42f05e0f984e tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:36:07 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 1073741824" returned: 0 in 0.492s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:07 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:07 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:07 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4115b220-ec6d-42a8-adca-f8607be98892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd43905a-2246-45c0-800e-59a07fb51071', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099fb824-fc45-48f7-933c-84643b161790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Volume volume-cd43905a-2246-45c0-800e-59a07fb51071 (cd43905a-2246-45c0-800e-59a07fb51071): created successfully Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099fb824-fc45-48f7-933c-84643b161790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (7e5013c7-286e-4f0f-a123-602b58bb2cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-31442049-416a-40b3-ae94-b9682af54365 tempest-VolumesSnapshotTestJSON-630951326 None] Created volume successfully. Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-badcd1ae-6d96-48e7-bf85-1c35d51737fc-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "cinder-badcd1ae-6d96-48e7-bf85-1c35d51737fc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-quobyte-badcd1ae-6d96-48e7-bf85-1c35d51737fc" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-badcd1ae-6d96-48e7-bf85-1c35d51737fc" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c271f-d5ed-49c2-a988-831e594b64c7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:07 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc Jul 28 14:36:07 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:08 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:08 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc Jul 28 14:36:08 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:08 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-badcd1ae-6d96-48e7-bf85-1c35d51737fc" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-badcd1ae-6d96-48e7-bf85-1c35d51737fc" released by "delete_volume" :: held 0.714s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Created reservations ['92fb4161-5f3a-4d3c-8def-425c75f7c79e', 'f68ea5d7-4b8d-4ee0-be20-4e6df704526a', '4cae46c4-101c-4314-94f8-7aa34aa5917a', 'c1599bed-3a7b-45dd-ad33-48f3dddde1f5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Creating offline snapshot 80174093-b2b5-44c3-9ccf-d2257421776e of volume cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d173c-cbb7-4438-bd61-acdbe2ca5be2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:08 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:08 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:08 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:08 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:09 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.337s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Deleted volume successfully. Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ddb6ff5-bc86-4654-b353-10a8ca4b550c tempest-VolumesActionsTest-63932526 None] Lock "cinder-badcd1ae-6d96-48e7-bf85-1c35d51737fc-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:09 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.497s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:09 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e 1G Jul 28 14:36:09 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (b592fa51-7672-423a-8c37-a8f5b6345ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e571feb7-a4fe-4c93-bafc-6896f807a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e571feb7-a4fe-4c93-bafc-6896f807a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1591113307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b6f910-fa85-46e0-9e95-2f01afe83a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:10Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab4ce21-cdf2-4439-bfcd-c9cfcb290779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab4ce21-cdf2-4439-bfcd-c9cfcb290779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b198d18-db94-4130-ad01-b60709899628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b198d18-db94-4130-ad01-b60709899628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b6f910-fa85-46e0-9e95-2f01afe83a74', 'volume_name': 'volume-00b6f910-fa85-46e0-9e95-2f01afe83a74', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2cea97-98a5-40ae-a6f1-c62a1154b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2cea97-98a5-40ae-a6f1-c62a1154b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891059b9-3a50-4b95-9eee-c88b580da7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:09 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Volume 00b6f910-fa85-46e0-9e95-2f01afe83a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b6f910-fa85-46e0-9e95-2f01afe83a74', 'volume_size': 1} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:09 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e 1G" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd43905a-2246-45c0-800e-59a07fb51071 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:09 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd43905a-2246-45c0-800e-59a07fb51071 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:09 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:10 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd43905a-2246-45c0-800e-59a07fb51071 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:10 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e is being set with open permissions: ugo+rw Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:10 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:10 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:10 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:10 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info Jul 28 14:36:10 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:10 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:10 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info is being set with open permissions: ugo+rw Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:10 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info Jul 28 14:36:10 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:10 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.info" returned: 0 in 0.248s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1591113307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b6f910-fa85-46e0-9e95-2f01afe83a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:10Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Creating volume 00b6f910-fa85-46e0-9e95-2f01afe83a74 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:10 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:10 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 1073741824 Jul 28 14:36:10 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-78840e8c-7484-4435-8f5d-7d94f7307d9d tempest-VolumesSnapshotTestJSON-630951326 None] Create snapshot completed successfully Jul 28 14:36:11 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 1073741824" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:11 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 Jul 28 14:36:11 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:11 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891059b9-3a50-4b95-9eee-c88b580da7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b6f910-fa85-46e0-9e95-2f01afe83a74', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb80517-6e47-4402-b711-ffe10bbf30e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:11 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Volume volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 (00b6f910-fa85-46e0-9e95-2f01afe83a74): created successfully Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb80517-6e47-4402-b711-ffe10bbf30e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (b592fa51-7672-423a-8c37-a8f5b6345ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ba63acfb-fb6a-4d5b-bf36-3e18a3f4dda5 tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (9a0f5493-1183-4c0b-b4c5-5469e52542ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22830534-aaf7-4d98-b6ac-b032b6d9ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22830534-aaf7-4d98-b6ac-b032b6d9ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-317190261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466b2e0f-5558-4487-bce1-d85b91b8cb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=80174093-b2b5-44c3-9ccf-d2257421776e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:12Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c35b557-e95a-4fe8-87df-8e6467e33cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c35b557-e95a-4fe8-87df-8e6467e33cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d70053-d143-4c07-ba94-4a9d6ed8a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d70053-d143-4c07-ba94-4a9d6ed8a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '466b2e0f-5558-4487-bce1-d85b91b8cb6e', 'volume_name': 'volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e', 'volume_size': 2, 'snapshot_id': '80174093-b2b5-44c3-9ccf-d2257421776e'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fe1ef8-9f8d-4d4b-94c7-55c5bee3410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fe1ef8-9f8d-4d4b-94c7-55c5bee3410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907a6ecb-f383-4c19-b9ae-7a7878367970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Volume 466b2e0f-5558-4487-bce1-d85b91b8cb6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e', 'volume_size': 2, 'snapshot_id': '80174093-b2b5-44c3-9ccf-d2257421776e'} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e-466b2e0f-5558-4487-bce1-d85b91b8cb6e" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e-466b2e0f-5558-4487-bce1-d85b91b8cb6e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Creating volume 466b2e0f-5558-4487-bce1-d85b91b8cb6e from snapshot 80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] snapshot: 80174093-b2b5-44c3-9ccf-d2257421776e, volume: 466b2e0f-5558-4487-bce1-d85b91b8cb6e, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2b6de7-2780-42ce-acb4-53cbbd97e6da]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-00b6f910-fa85-46e0-9e95-2f01afe83a74-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "cinder-00b6f910-fa85-46e0-9e95-2f01afe83a74-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-quobyte-00b6f910-fa85-46e0-9e95-2f01afe83a74" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:12 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:12 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-00b6f910-fa85-46e0-9e95-2f01afe83a74" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41a747-a82e-43ae-a91c-14a02a000a15]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:13 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 Jul 28 14:36:13 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:13 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd43905a-2246-45c0-800e-59a07fb51071(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[febed31e-541e-42fc-b8ae-3784c55c06db]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:13 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:13 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:13 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74" returned: 0 in 0.424s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:13 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74 Jul 28 14:36:13 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:13 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:13 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e Jul 28 14:36:13 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:13 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-00b6f910-fa85-46e0-9e95-2f01afe83a74" returned: 0 in 0.332s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-00b6f910-fa85-46e0-9e95-2f01afe83a74" released by "delete_volume" :: held 0.803s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Created reservations ['d4440009-244a-4084-b07e-f2c8e3ec63d8', '11c9a90e-f5cf-405f-aaa2-3745fdd94729', 'ec93d166-6fa1-43c1-9058-dfa6cf4f2afb', '82d2cfe0-90ac-4b3e-b992-ea38e4e95fa3'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:13 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:13 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:14 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:14 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:14 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Deleted volume successfully. Jul 28 14:36:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8ee9f3ff-76ce-458f-8394-c20729bd3f45 tempest-VolumesActionsTest-63932526 None] Lock "cinder-00b6f910-fa85-46e0-9e95-2f01afe83a74-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (3dd81f95-6b75-43f5-9a4c-45323c2f2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aa224a-7f0a-4ea2-82d7-ac64d56cc2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aa224a-7f0a-4ea2-82d7-ac64d56cc2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-444171900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0549fcc-5fc8-44d6-a1af-5eebd87b7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:15Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6216a2-2a0b-496a-afc4-9521e3c4d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6216a2-2a0b-496a-afc4-9521e3c4d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25f09e-0453-48b9-bd5d-4df79de71edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25f09e-0453-48b9-bd5d-4df79de71edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0549fcc-5fc8-44d6-a1af-5eebd87b7f85', 'volume_name': 'volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85faf70-87b4-4956-839e-fe2ec5d239f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85faf70-87b4-4956-839e-fe2ec5d239f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24315062-e60d-4a89-8344-09d6105673ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:15 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Volume f0549fcc-5fc8-44d6-a1af-5eebd87b7f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85', 'volume_size': 1} Jul 28 14:36:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:18 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e" returned: 0 in 5.071s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053c726-f8ef-4779-9369-906761a19679]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:18 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:18 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:19 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.534s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:36:19 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Converted 1024.00 MB image at 201.90 MB/s Jul 28 14:36:19 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e is being set with open permissions: ugo+rw Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:19 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e Jul 28 14:36:19 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:19 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e" returned: 0 in 0.277s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" released by "_copy_volume_from_snapshot" :: held 6.885s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e-466b2e0f-5558-4487-bce1-d85b91b8cb6e" released by "_create_volume_from_snapshot" :: held 6.920s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.938s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.400s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-444171900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0549fcc-5fc8-44d6-a1af-5eebd87b7f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:15Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Creating volume f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:19 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:19 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 1073741824 Jul 28 14:36:19 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907a6ecb-f383-4c19-b9ae-7a7878367970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e', 'volume_size': 2, 'snapshot_id': '80174093-b2b5-44c3-9ccf-d2257421776e'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f546e-7565-4340-8691-29a7b006715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Volume volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e (466b2e0f-5558-4487-bce1-d85b91b8cb6e): created successfully Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528f546e-7565-4340-8691-29a7b006715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (9a0f5493-1183-4c0b-b4c5-5469e52542ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:19 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-14a05441-5d75-430f-b738-21288d21ebe8 tempest-VolumesSnapshotTestJSON-630951326 None] Created volume successfully. Jul 28 14:36:20 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 1073741824" returned: 0 in 0.462s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:20 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 Jul 28 14:36:20 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-466b2e0f-5558-4487-bce1-d85b91b8cb6e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-466b2e0f-5558-4487-bce1-d85b91b8cb6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:20 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24315062-e60d-4a89-8344-09d6105673ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca730978-f75a-4aca-b14b-70975a6c3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Volume volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 (f0549fcc-5fc8-44d6-a1af-5eebd87b7f85): created successfully Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca730978-f75a-4aca-b14b-70975a6c3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (3dd81f95-6b75-43f5-9a4c-45323c2f2b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c357f910-1477-4c4b-b087-75c9fac94c57 tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e7878b-fbe6-4bab-a308-93546269497e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:20 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e Jul 28 14:36:20 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:20 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e" returned: 0 in 0.451s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:20 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e Jul 28 14:36:20 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:21 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-466b2e0f-5558-4487-bce1-d85b91b8cb6e" returned: 0 in 0.277s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-466b2e0f-5558-4487-bce1-d85b91b8cb6e" released by "delete_volume" :: held 0.786s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['d7a29073-813d-4c7b-8f1e-b84973e9f22f', '06e30789-6f0e-45a9-9f8f-11441ba06a2d', '41604825-de2f-4e97-9098-29c0d11b1c93', '1af2bf74-ccfc-48db-9ff7-bb5c63509fc2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-80174093-b2b5-44c3-9ccf-d2257421776e-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-80174093-b2b5-44c3-9ccf-d2257421776e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Deleting offline snapshot 80174093-b2b5-44c3-9ccf-d2257421776e of volume cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:36:21 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] snapshot_file for this snap is: volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.320s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed79b38-60c6-49b6-b782-e9c79be2a4b5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Deleted volume successfully. Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1ca10109-3880-451e-afe9-d278975fbf41 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-466b2e0f-5558-4487-bce1-d85b91b8cb6e-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "cinder-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-quobyte-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:21 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:21 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49010d-35ae-4830-bf58-b4e6d0ce2514]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:22 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 Jul 28 14:36:22 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:22 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.420s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd43905a-2246-45c0-800e-59a07fb51071(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9311e50-3d82-4c18-9d84-8baa46163e2b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:22 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:22 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:22 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:22 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85 Jul 28 14:36:22 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:22 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85" released by "delete_volume" :: held 0.730s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:22 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.433s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:22 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:22 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Created reservations ['5a07bc39-1417-4667-85d2-193968a1f9b7', '490ab70b-e4a3-4c4c-8352-b4c37c503071', 'ce051e05-0a92-4be1-85b6-60de540270e1', '9474fa92-535e-4dee-bb5a-5102f5ee1c34'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:22 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:22 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:23 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.461s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:23 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e Jul 28 14:36:23 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:23 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.325s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Deleted volume successfully. Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1c2ac638-b56d-41b0-b877-e88c1420a20c tempest-VolumesActionsTest-63932526 None] Lock "cinder-f0549fcc-5fc8-44d6-a1af-5eebd87b7f85-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:23 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071.80174093-b2b5-44c3-9ccf-d2257421776e" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-80174093-b2b5-44c3-9ccf-d2257421776e" released by "_delete_snapshot" :: held 1.758s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" released by "delete_snapshot" :: held 1.798s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['a99fef2f-8fee-46d7-a92e-d03990ec72f0', '57f0857c-3782-42cb-b106-52922aad443b', '363f1542-1a54-4e8f-bfb1-a9abb626efbf', 'f04623b9-a208-4c68-804e-3a3fc1236a96'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Delete snapshot completed successfully. Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-462a638c-fabe-49cc-bc69-2b46e06f5bce tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-80174093-b2b5-44c3-9ccf-d2257421776e-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (ff378e4d-b850-436c-97a0-9e118802b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c40be-4941-4fd1-bf54-c9c1f6f4e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4c40be-4941-4fd1-bf54-c9c1f6f4e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145102761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8c30c9-b37f-4988-ba95-f41f6b9b92e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:24Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec841f-cb94-4e95-becc-0ed7cbd3f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dec841f-cb94-4e95-becc-0ed7cbd3f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161947ea-521b-440f-91f1-5fc37a3f040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161947ea-521b-440f-91f1-5fc37a3f040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8c30c9-b37f-4988-ba95-f41f6b9b92e8', 'volume_name': 'volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a66f5a3-5dc5-423a-99e3-a4b8a96581a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a66f5a3-5dc5-423a-99e3-a4b8a96581a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f0487-eef2-4141-8104-8da933167c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:23 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Volume ca8c30c9-b37f-4988-ba95-f41f6b9b92e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8', 'volume_size': 1} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145102761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8c30c9-b37f-4988-ba95-f41f6b9b92e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:24Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Creating volume ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:23 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:23 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 1073741824 Jul 28 14:36:23 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-cd43905a-2246-45c0-800e-59a07fb51071-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-cd43905a-2246-45c0-800e-59a07fb51071-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f2c6ac-5227-4228-a4da-3412d6b0a95e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:24 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:24 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:24 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 1073741824" returned: 0 in 0.521s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:24 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 Jul 28 14:36:24 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:24 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:24 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071 Jul 28 14:36:24 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:24 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f0487-eef2-4141-8104-8da933167c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6fb082-45f6-42f8-93c3-a1a28fc9aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Volume volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 (ca8c30c9-b37f-4988-ba95-f41f6b9b92e8): created successfully Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6fb082-45f6-42f8-93c3-a1a28fc9aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (ff378e4d-b850-436c-97a0-9e118802b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-59e76245-f598-480c-a5e9-a5530846a5d7 tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:36:24 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-cd43905a-2246-45c0-800e-59a07fb51071" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-cd43905a-2246-45c0-800e-59a07fb51071" released by "delete_volume" :: held 0.809s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['ba0ba565-032d-44f5-b2ce-66bf2044463a', '77722605-fcb2-498f-ac7c-7a327eb66b2d', 'ca7ce555-0aae-485d-94aa-37b8675d01bd', '715f6478-5f45-4d80-9e38-f1a46b5f3537'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:24 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:24 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:25 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.261s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Deleted volume successfully. Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dd19d1ce-8954-4c25-bdcc-2b538726dc99 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-cd43905a-2246-45c0-800e-59a07fb51071-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Flow 'volume_create_manager' (ba74d494-cf38-4b0b-99e8-8ac6244e707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff001af-47cc-4c60-87ab-80ff7cb8f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff001af-47cc-4c60-87ab-80ff7cb8f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-711255151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b7009-c2eb-4d46-ace7-410ca4fd43e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cc50a49b2d48cba021e242b8542034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:25Z,use_quota=True,user_id='592687c8d1b448a58f63b2d92850d962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e91e8c-700e-4afb-8895-a1221c099ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e91e8c-700e-4afb-8895-a1221c099ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bd62ba-acfe-41ce-b1a9-532c1216e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (823530fe-4921-448a-a5ab-52ddbc12c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f91cf63-fbfa-4084-b4dd-d9217ca56837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f91cf63-fbfa-4084-b4dd-d9217ca56837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-112493472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:26Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86decbbb-c1f2-484a-bdd0-1f4eedf87b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86decbbb-c1f2-484a-bdd0-1f4eedf87b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9283700c-7d55-462d-8c45-106c21d5b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9283700c-7d55-462d-8c45-106c21d5b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7', 'volume_name': 'volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7c1e3a-f9f0-4b2a-9023-053eeeb502e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7c1e3a-f9f0-4b2a-9023-053eeeb502e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93bb0f0-e5e0-40e2-b2cb-53ebfaa4544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:25 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Volume ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7', 'volume_size': 1} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-112493472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:26Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Creating volume ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:25 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:25 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 1073741824 Jul 28 14:36:25 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "cinder-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Acquiring lock "cinder-quobyte-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a389ec-c20e-40e1-b1bf-d34387e42529]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:26 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 Jul 28 14:36:26 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bd62ba-acfe-41ce-b1a9-532c1216e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'volume_name': 'volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ab7141-5a88-4f0a-b44c-82725f7d710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ab7141-5a88-4f0a-b44c-82725f7d710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d1620-56bd-4431-89e6-233069dddafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:26 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Trying to clone 951b7009-c2eb-4d46-ace7-410ca4fd43e9 from image b313c492-604e-4cdd-96f9-0cabb9f2068f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:36:26 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 1073741824" returned: 0 in 0.498s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:26 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" returned: 0 in 0.390s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:26 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8 Jul 28 14:36:26 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:26 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:26 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:36:26 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Image download 20.69 MB at 20.69 MB/s Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[60befc7d-586e-47f1-9f23-daeaac53a97a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:26 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "cinder-quobyte-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8" released by "delete_volume" :: held 0.738s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:26 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD Jul 28 14:36:26 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Created reservations ['3d1cf043-1caa-44be-9d9d-76ba55b28ad7', '33181db1-4ad5-4ff3-bdbf-fa63c63a1063', 'a5bbed35-1a67-4bda-baf5-24cbecd6b07a', '8cbf55f6-fddc-435a-9382-f2c943694509'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:26 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.301s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93bb0f0-e5e0-40e2-b2cb-53ebfaa4544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597129e3-adf0-421d-8dab-19b4af68f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:26 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Volume volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 (ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7): created successfully Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597129e3-adf0-421d-8dab-19b4af68f09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (823530fe-4921-448a-a5ab-52ddbc12c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-74529e16-07a8-43a7-87d6-f4b16af0011c tempest-VolumesSnapshotTestJSON-630951326 None] Created volume successfully. Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:26 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:26 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:26 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:26 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f is fetched for user 592687c8d1b448a58f63b2d92850d962. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dcc23e-47f1-46d9-9184-c49a15de788d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:27 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Deleted volume successfully. Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9cc3336-bbdf-48aa-b0e9-0504049ac8b1 tempest-VolumesActionsTest-63932526 None] Lock "cinder-ca8c30c9-b37f-4988-ba95-f41f6b9b92e8-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:27 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD Jul 28 14:36:27 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:27 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-711255151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b7009-c2eb-4d46-ace7-410ca4fd43e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cc50a49b2d48cba021e242b8542034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:25Z,use_quota=True,user_id='592687c8d1b448a58f63b2d92850d962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Creating volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:27 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:27 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1073741824 Jul 28 14:36:27 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (376ac455-b3e5-43a7-ad01-a74e722548b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac5c16-c55c-4c20-9fdc-c8cfe4f4af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac5c16-c55c-4c20-9fdc-c8cfe4f4af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-181696287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a7439e-a91d-436d-8558-901d314d257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:27Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba547648-1aec-4d20-b520-76c2847862c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba547648-1aec-4d20-b520-76c2847862c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af9000-1581-463a-b716-4cef08f000f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af9000-1581-463a-b716-4cef08f000f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a7439e-a91d-436d-8558-901d314d257e', 'volume_name': 'volume-a8a7439e-a91d-436d-8558-901d314d257e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93c5085-dda1-4449-98ba-f02a3029e777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93c5085-dda1-4449-98ba-f02a3029e777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1b887-b428-4c40-92c5-2ad41c17d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Volume a8a7439e-a91d-436d-8558-901d314d257e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a7439e-a91d-436d-8558-901d314d257e', 'volume_size': 1} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:27 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1073741824" returned: 0 in 0.491s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:27 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 Jul 28 14:36:27 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:28 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-181696287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a7439e-a91d-436d-8558-901d314d257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161f26b7425444fab28603e3148f56a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:27Z,use_quota=True,user_id='07f5ba365c1049ffa0e6cf4866209e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Creating volume a8a7439e-a91d-436d-8558-901d314d257e {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:28 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:28 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e 1073741824 Jul 28 14:36:28 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Attempting download of b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961925b-44d1-4315-aa5e-f6208c6f51c3]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:28 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9 Jul 28 14:36:28 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:28 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:28 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e 1073741824" returned: 0 in 0.459s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:28 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e Jul 28 14:36:28 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:28 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9 Jul 28 14:36:28 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:28 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.105s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1b887-b428-4c40-92c5-2ad41c17d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a7439e-a91d-436d-8558-901d314d257e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02d074-00a6-4588-bd14-69ff770ac332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:28 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Creating offline snapshot b757fb7a-0099-4e5e-bf1d-ea0eca29f684 of volume ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9" returned: 1 in 0.327s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b313c492-604e-4cdd-96f9-0cabb9f2068f_fvkdvsg9' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:36:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Volume volume-a8a7439e-a91d-436d-8558-901d314d257e (a8a7439e-a91d-436d-8558-901d314d257e): created successfully Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac02d074-00a6-4588-bd14-69ff770ac332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Flow 'volume_create_manager' (376ac455-b3e5-43a7-ad01-a74e722548b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba7684-cd92-48aa-b16f-3a90a0449fef]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7931bb-53c4-40bd-a830-5526878c463b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d1a3d043-a373-4cd5-b2db-72904cc7503f tempest-VolumesActionsTest-628251966 None] Created volume successfully. Jul 28 14:36:29 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD Jul 28 14:36:29 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:29 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:29 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:29 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] b313c492-604e-4cdd-96f9-0cabb9f2068f was qcow2, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:29 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 Jul 28 14:36:29 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:29 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.391s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:29 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 1G Jul 28 14:36:29 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:29 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 1G" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:29 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:29 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-a8a7439e-a91d-436d-8558-901d314d257e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:30 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:30 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 is being set with open permissions: ugo+rw Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "cinder-a8a7439e-a91d-436d-8558-901d314d257e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:30 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:30 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Acquiring lock "cinder-quobyte-a8a7439e-a91d-436d-8558-901d314d257e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "cinder-quobyte-a8a7439e-a91d-436d-8558-901d314d257e" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7978d336-0b6a-4c04-a05a-3fab58eaf950]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:30 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e Jul 28 14:36:30 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:30 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:30 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info Jul 28 14:36:30 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:30 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e" returned: 0 in 0.425s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:30 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e Jul 28 14:36:30 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:30 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:30 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info is being set with open permissions: ugo+rw Jul 28 14:36:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:30 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info Jul 28 14:36:30 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:31 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.info" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:31 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a8a7439e-a91d-436d-8558-901d314d257e" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "cinder-quobyte-a8a7439e-a91d-436d-8558-901d314d257e" released by "delete_volume" :: held 0.833s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-849bd0ea-3012-4716-8cdb-444c29bfca63 tempest-VolumesSnapshotTestJSON-630951326 None] Create snapshot completed successfully Jul 28 14:36:31 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9" returned: 0 in 1.861s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b313c492-604e-4cdd-96f9-0cabb9f2068f_88ivz6aydevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:36:31 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Converted 112.00 MB image at 60.12 MB/s Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:31 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1G Jul 28 14:36:31 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Created reservations ['c30bf431-de71-4e84-bb88-5da2dfb1ef5e', 'f14844a7-5575-4378-b01e-f42bbe956431', '2a600930-ae88-48f6-92bd-2ae271d018c0', '17665da3-85ad-413e-82dc-7bb835d68e24'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:31 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:31 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:31 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 1G" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Downloaded image b313c492-604e-4cdd-96f9-0cabb9f2068f ((None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}])) to volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9 successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Temporary image b313c492-604e-4cdd-96f9-0cabb9f2068f for user 592687c8d1b448a58f63b2d92850d962 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Marking volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9 as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:36:31 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Copying metadata from image b313c492-604e-4cdd-96f9-0cabb9f2068f to 951b7009-c2eb-4d46-ace7-410ca4fd43e9. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Creating volume glance metadata for volume 951b7009-c2eb-4d46-ace7-410ca4fd43e9 backed by image b313c492-604e-4cdd-96f9-0cabb9f2068f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:36:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Deleted volume successfully. Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4458d532-3366-4cb7-9a27-276d2129195b tempest-VolumesActionsTest-628251966 None] Lock "cinder-a8a7439e-a91d-436d-8558-901d314d257e-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d1620-56bd-4431-89e6-233069dddafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'volume_size': 1, 'image_id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b313c492-604e-4cdd-96f9-0cabb9f2068f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95eb4c9e4cdc42be8f0df95df6a8a6f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b313c492-604e-4cdd-96f9-0cabb9f2068f', 'created_at': datetime.datetime(2026, 7, 28, 12, 19, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 19, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b313c492-604e-4cdd-96f9-0cabb9f2068f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b778cd-baf0-4ffb-b3e5-c29f627448e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Volume volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 (951b7009-c2eb-4d46-ace7-410ca4fd43e9): created successfully Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b778cd-baf0-4ffb-b3e5-c29f627448e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Flow 'volume_create_manager' (ba74d494-cf38-4b0b-99e8-8ac6244e707e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ebaf089a-e154-467c-ac56-a6a33afb841b tempest-TestShelveInstance-1980310390 None] Created volume successfully. Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (d8bbd8bb-afe4-43fb-8278-b07020fe0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc93bc99-9b7b-4afb-91c1-763fd3757167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc93bc99-9b7b-4afb-91c1-763fd3757167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570565511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dbb8eb-82c1-413b-9a67-a9acd84739ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4791adc1704e4a8cac4bcc8b92eb9b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b757fb7a-0099-4e5e-bf1d-ea0eca29f684,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:33Z,use_quota=True,user_id='6f56b8a07aad4fe88f8705921f7ce55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8230a896-f68c-46e8-abaa-2dbcad3f0e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8230a896-f68c-46e8-abaa-2dbcad3f0e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63887abb-1914-4b50-8ddf-14d3210c7281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63887abb-1914-4b50-8ddf-14d3210c7281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21dbb8eb-82c1-413b-9a67-a9acd84739ab', 'volume_name': 'volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab', 'volume_size': 1, 'snapshot_id': 'b757fb7a-0099-4e5e-bf1d-ea0eca29f684'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a8af2-5f43-4547-8fdc-f1eddad9939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a8af2-5f43-4547-8fdc-f1eddad9939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb36f914-c5e3-4f3a-99b1-c5c232daab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Volume 21dbb8eb-82c1-413b-9a67-a9acd84739ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab', 'volume_size': 1, 'snapshot_id': 'b757fb7a-0099-4e5e-bf1d-ea0eca29f684'} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-21dbb8eb-82c1-413b-9a67-a9acd84739ab" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-21dbb8eb-82c1-413b-9a67-a9acd84739ab" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Creating volume 21dbb8eb-82c1-413b-9a67-a9acd84739ab from snapshot b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] snapshot: b757fb7a-0099-4e5e-bf1d-ea0eca29f684, volume: 21dbb8eb-82c1-413b-9a67-a9acd84739ab, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bacb76-187a-4130-8012-4697ec882d78]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:33 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:33 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:33 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.451s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4e0f4-a446-443c-bf62-1368b15b620d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:33 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:33 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:33 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:36:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:33 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab Jul 28 14:36:33 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-56ea19f5-708e-4dc7-973c-3e9282ac6b32 req-77823404-6bcc-47ac-8e15-052b53b6577e tempest-TestShelveInstance-1980310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:39 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab" returned: 0 in 5.770s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28dfd5-61fb-4aeb-bbd3-cb5013fc6fce]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:39 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:39 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:40 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.604s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:36:40 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Converted 1024.00 MB image at 177.44 MB/s Jul 28 14:36:40 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab is being set with open permissions: ugo+rw Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:40 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab Jul 28 14:36:40 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:40 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab" returned: 0 in 0.319s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" released by "_copy_volume_from_snapshot" :: held 7.684s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-21dbb8eb-82c1-413b-9a67-a9acd84739ab" released by "_create_volume_from_snapshot" :: held 7.730s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.747s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-56ea19f5-708e-4dc7-973c-3e9282ac6b32 req-77823404-6bcc-47ac-8e15-052b53b6577e tempest-TestShelveInstance-1980310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.979s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-56ea19f5-708e-4dc7-973c-3e9282ac6b32 req-77823404-6bcc-47ac-8e15-052b53b6577e tempest-TestShelveInstance-1980310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb36f914-c5e3-4f3a-99b1-c5c232daab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab', 'volume_size': 1, 'snapshot_id': 'b757fb7a-0099-4e5e-bf1d-ea0eca29f684'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004fc82-6720-46a8-9bc5-e2f789148d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:40 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Volume volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab (21dbb8eb-82c1-413b-9a67-a9acd84739ab): created successfully Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004fc82-6720-46a8-9bc5-e2f789148d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Flow 'volume_create_manager' (d8bbd8bb-afe4-43fb-8278-b07020fe0313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:40 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-56ea19f5-708e-4dc7-973c-3e9282ac6b32 req-77823404-6bcc-47ac-8e15-052b53b6577e tempest-TestShelveInstance-1980310390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e13b32e-2dba-4a05-bc41-424675963b31', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:36:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d06c2cad-a5d3-45d0-818b-e9190f7c84c6 tempest-VolumesSnapshotTestJSON-630951326 None] Created volume successfully. Jul 28 14:36:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-56ea19f5-708e-4dc7-973c-3e9282ac6b32 req-77823404-6bcc-47ac-8e15-052b53b6577e tempest-TestShelveInstance-1980310390 None] attachment_update completed successfully. Jul 28 14:36:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-21dbb8eb-82c1-413b-9a67-a9acd84739ab-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-21dbb8eb-82c1-413b-9a67-a9acd84739ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" acquired by "delete_volume" :: waited 0.038s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba624c0-c797-4208-8f10-2b7b15cc4be0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:42 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab Jul 28 14:36:42 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:42 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab" returned: 0 in 0.653s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:42 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab Jul 28 14:36:42 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:43 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-21dbb8eb-82c1-413b-9a67-a9acd84739ab" returned: 0 in 0.348s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-21dbb8eb-82c1-413b-9a67-a9acd84739ab" released by "delete_volume" :: held 1.125s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['cabdb06c-5f61-49bd-85c4-f25abaa4062a', '7ebed2ae-be51-49ac-bc6f-9b9e83f00946', '312e74f1-0715-46b7-b384-29820216009e', '6464ea83-2b4e-441b-9dc9-fd0f809640a8'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:43 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:43 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:43 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.325s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Deleted volume successfully. Jul 28 14:36:43 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0420e8d1-40aa-4598-be8f-f41bce3f94fd tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-21dbb8eb-82c1-413b-9a67-a9acd84739ab-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Deleting offline snapshot b757fb7a-0099-4e5e-bf1d-ea0eca29f684 of volume ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] snapshot_file for this snap is: volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b04a5-b756-4429-bda4-76df2cfc7f57]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:44 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:44 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:44 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba149817-3ed4-4ea1-8566-15c0716c36ef]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:44 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:44 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:45 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.539s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:45 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:45 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:45 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.452s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:45 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684 Jul 28 14:36:45 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:45 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7.b757fb7a-0099-4e5e-bf1d-ea0eca29f684" returned: 0 in 0.289s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-b757fb7a-0099-4e5e-bf1d-ea0eca29f684" released by "_delete_snapshot" :: held 1.830s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" released by "delete_snapshot" :: held 1.868s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['c3b66924-3889-475e-a4c2-90f0f189916b', 'aa260ab5-009b-4af2-aeca-06ebba7b3d31', '8d805138-447a-4364-bc00-145dc35095a2', 'f74e2370-c5a4-47f5-bc62-197f5263a6b5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Delete snapshot completed successfully. Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-02659f4f-8ac0-4cf9-a63e-caad0b3a80a5 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-b757fb7a-0099-4e5e-bf1d-ea0eca29f684-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92e43d-f34c-435d-80ef-b78043e20336]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:46 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:46 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:47 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.556s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:47 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7 Jul 28 14:36:47 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:47 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" returned: 0 in 0.357s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7" released by "delete_volume" :: held 1.023s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['bd12c4a4-46ba-40ed-98c4-a899643976f5', '704ba372-e984-45aa-90f3-4d08f75094a0', 'cdab0212-c4a8-41ac-aa83-2d0631ec8ff9', '56731338-d0fd-4d44-92ce-a47d45c545cd'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:47 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:47 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:48 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:48 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Deleted volume successfully. Jul 28 14:36:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-514edd74-d75b-4b1f-88b6-be65923e6394 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-ab5a19fb-89c3-4d83-8cc0-372d5f8fb2a7-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-683f4365-c480-458f-b426-f4b7f22d3c20-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-683f4365-c480-458f-b426-f4b7f22d3c20-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:49 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:49 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe057ca5-7597-49bb-b44a-bbdda6fb9b11]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:49 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 Jul 28 14:36:49 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:49 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.609s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:36:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:36:50 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20" returned: 0 in 0.763s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:50 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20 Jul 28 14:36:50 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:50 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-683f4365-c480-458f-b426-f4b7f22d3c20" returned: 0 in 0.457s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-quobyte-683f4365-c480-458f-b426-f4b7f22d3c20" released by "delete_volume" :: held 1.346s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Created reservations ['8e6d2631-84e3-44ae-9579-d00c271cb5ba', 'e393ce2b-a3a5-4bb8-a786-fcac58028fb5', 'fc3e551d-beb5-4f90-ac89-2a0694d0d8c1', 'a2ef5635-ef21-4833-866d-28bd959e774f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:50 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:36:50 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:51 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:36:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Deleted volume successfully. Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6eee4d6b-22fe-4b7d-b580-185a539096b2 tempest-VolumesSnapshotTestJSON-630951326 None] Lock "cinder-683f4365-c480-458f-b426-f4b7f22d3c20-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (b25f8bb5-df6a-40b3-831c-f72b3fd3f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ad67a4-78cc-4572-9a66-cd7c0ac29940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ad67a4-78cc-4572-9a66-cd7c0ac29940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-209856048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b84e3-0744-4750-8de8-175719556321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aa669e4e4648358a419d1aecd292bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:52Z,use_quota=True,user_id='e18a3da5926143d4ae8b8503e452f756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8e1a8-aac7-4564-b8a6-3074542c52ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8e1a8-aac7-4564-b8a6-3074542c52ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f029e2-eedf-488f-9e82-4842a32c0f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f029e2-eedf-488f-9e82-4842a32c0f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320b84e3-0744-4750-8de8-175719556321', 'volume_name': 'volume-320b84e3-0744-4750-8de8-175719556321', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9556b52d-a46a-42f4-bcfa-b8fa5ea8c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9556b52d-a46a-42f4-bcfa-b8fa5ea8c666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b814d82-2d78-40e2-b727-7928830f4661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:51 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Volume 320b84e3-0744-4750-8de8-175719556321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320b84e3-0744-4750-8de8-175719556321', 'volume_size': 1} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-209856048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b84e3-0744-4750-8de8-175719556321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aa669e4e4648358a419d1aecd292bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:52Z,use_quota=True,user_id='e18a3da5926143d4ae8b8503e452f756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Creating volume 320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:51 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:51 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 1073741824 Jul 28 14:36:51 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:52 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 1073741824" returned: 0 in 0.455s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:52 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:36:52 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:52 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b814d82-2d78-40e2-b727-7928830f4661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320b84e3-0744-4750-8de8-175719556321', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a18bb81-cb40-4820-b08d-75c52e80447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:52 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Volume volume-320b84e3-0744-4750-8de8-175719556321 (320b84e3-0744-4750-8de8-175719556321): created successfully Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a18bb81-cb40-4820-b08d-75c52e80447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (b25f8bb5-df6a-40b3-831c-f72b3fd3f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a7bd8280-3899-4521-ae03-c84b58eabbba tempest-VolumesDeleteCascade-1023724756 None] Created volume successfully. Jul 28 14:36:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Creating offline snapshot 1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 of volume 320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:36:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f43935-4f11-4106-ac53-585ee795ffe6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:54 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:36:54 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:54 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.434s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:54 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 1G Jul 28 14:36:54 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:55 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 1G" returned: 0 in 0.516s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:55 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:36:55 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:55 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:55 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 is being set with open permissions: ugo+rw Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:55 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:36:55 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:55 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=137,cinder:INSERT=41,cinder:UPDATE=151,cinder:DELETE=13 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=156,cinder:SELECT=140,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:36:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:55 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info Jul 28 14:36:55 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:56 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:56 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info is being set with open permissions: ugo+rw Jul 28 14:36:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:56 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info Jul 28 14:36:56 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:56 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.info" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-609a181d-5fed-4c4e-acae-aa6d586ee22e tempest-VolumesDeleteCascade-1023724756 None] Create snapshot completed successfully Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Creating offline snapshot c9df5353-5477-419e-8817-1dd76061ef47 of volume 320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936a0da-d698-45b1-9e24-ada6446a337d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:57 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:36:57 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Flow 'volume_create_manager' (c4956f56-2c1a-42df-9748-1c5c3067e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea9bd91-58c8-4291-8668-dbe6b5fe239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea9bd91-58c8-4291-8668-dbe6b5fe239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1591697102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07227feb-f702-4120-8c21-924d344b6499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4366dbfb2e46b3bbb7f6c3d0b6e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:58Z,use_quota=True,user_id='d476565d7664450eb8dfdb1224ca7787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e52b231-56cf-49df-816e-6baa9e3493e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e52b231-56cf-49df-816e-6baa9e3493e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21791ea-2cf9-484e-9d79-9f00ae9d70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21791ea-2cf9-484e-9d79-9f00ae9d70e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07227feb-f702-4120-8c21-924d344b6499', 'volume_name': 'volume-07227feb-f702-4120-8c21-924d344b6499', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851e5c17-7588-43c5-8856-060fdb3a2859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851e5c17-7588-43c5-8856-060fdb3a2859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c682950-9583-4511-bfd2-a6553cd7e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Volume 07227feb-f702-4120-8c21-924d344b6499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07227feb-f702-4120-8c21-924d344b6499', 'volume_size': 1} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:57 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.391s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b84e3-0744-4750-8de8-175719556321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:36:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:57 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 1G Jul 28 14:36:57 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:58 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 1G" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:58 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:36:58 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:58 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:58 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 is being set with open permissions: ugo+rw Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:58 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:36:58 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:58 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.514s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1591697102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07227feb-f702-4120-8c21-924d344b6499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4366dbfb2e46b3bbb7f6c3d0b6e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:36:58Z,use_quota=True,user_id='d476565d7664450eb8dfdb1224ca7787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Creating volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:36:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:36:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:58 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 1073741824 Jul 28 14:36:58 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-aa2143cb-5608-4d87-bdbd-cc254c8bdc31 tempest-VolumesDeleteCascade-1023724756 None] Create snapshot completed successfully Jul 28 14:36:59 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 1073741824" returned: 0 in 0.407s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:59 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 Jul 28 14:36:59 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-320b84e3-0744-4750-8de8-175719556321-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-320b84e3-0744-4750-8de8-175719556321-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Performing cascade delete. {{(pid=87385) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:59 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c682950-9583-4511-bfd2-a6553cd7e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07227feb-f702-4120-8c21-924d344b6499', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cce2c-3794-40d5-bb62-f44bfb134aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Deleting offline snapshot 1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 of volume 320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] snapshot_file for this snap is: volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:36:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Volume volume-07227feb-f702-4120-8c21-924d344b6499 (07227feb-f702-4120-8c21-924d344b6499): created successfully Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cce2c-3794-40d5-bb62-f44bfb134aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Flow 'volume_create_manager' (c4956f56-2c1a-42df-9748-1c5c3067e29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[005250c4-5b08-402a-9fe3-00c0b1403588]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:36:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:36:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9eb8edf2-d577-4c6e-b656-ec8973e8c4e6 tempest-VolumesSnapshotListTestJSON-689615162 None] Created volume successfully. Jul 28 14:36:59 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:36:59 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:00 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b84e3-0744-4750-8de8-175719556321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff38284-3aad-4e36-8c4c-117636d48221]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:00 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:37:00 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:00 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ef9f94-d173-4130-bbb4-db82c1d9cffc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:00 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:37:00 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Creating offline snapshot 9fd9ae34-6559-43fe-baf1-8ac270cab3c9 of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[815c7dd4-dea4-4ea0-84a9-d78cbb74ae8a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.466s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b84e3-0744-4750-8de8-175719556321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e05964-3cc0-493d-a69b-b024e0921ac1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 Jul 28 14:37:01 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:37:01 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499" returned: 0 in 0.410s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 1G Jul 28 14:37:01 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.420s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b84e3-0744-4750-8de8-175719556321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f22392-f8ed-4b05-b9b3-3cfe66dc7678]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:37:01 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 1G" returned: 0 in 0.431s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:01 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:01 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:01 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:37:01 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 is being set with open permissions: ugo+rw Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:02 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:02 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.340s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:02 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0 Jul 28 14:37:02 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.252s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:02 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info Jul 28 14:37:02 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 -F qcow2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:02 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 -F qcow2 Jul 28 14:37:02 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info is being set with open permissions: ugo+rw Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:02 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info Jul 28 14:37:02 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:02 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b84e3-0744-4750-8de8-175719556321 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 -F qcow2" returned: 0 in 0.313s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0" released by "_delete_snapshot" :: held 3.160s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" released by "delete_snapshot" :: held 3.195s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['90fab0ff-d837-4673-b679-6e5c4f2334ce', '8b8e42de-3094-4a83-8a45-04b082ffa4cc', 'de2fd2b1-7372-43ce-8bb1-f37b759b5c95', '20eff054-dd96-4d2e-8b1b-3b735b94fa9f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:02 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.info" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Delete snapshot completed successfully. Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-1c9f8e49-f8af-4fdf-a1fb-1e1863cb13d0-delete_snapshot" released by "delete_snapshot" :: held 3.370s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-c9df5353-5477-419e-8817-1dd76061ef47-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f6338e36-ac5a-417b-b281-62aac33d176c tempest-VolumesSnapshotListTestJSON-689615162 None] Create snapshot completed successfully Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-c9df5353-5477-419e-8817-1dd76061ef47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-c9df5353-5477-419e-8817-1dd76061ef47" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-c9df5353-5477-419e-8817-1dd76061ef47" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Deleting offline snapshot c9df5353-5477-419e-8817-1dd76061ef47 of volume 320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] snapshot_file for this snap is: volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c37e1b-4081-4b25-b681-bea3220dfee0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:03 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:37:03 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Creating offline snapshot 105e9aa8-3581-4f3f-a775-78e7d0361b6c of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f93386-9588-48d2-ab95-9888d8b93ebd]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:03 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:03 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:03 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.411s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b84e3-0744-4750-8de8-175719556321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73e58d3-eb80-4847-9ea0-3b3536282639]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:03 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:37:03 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:03 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:03 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c 1G Jul 28 14:37:03 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:03 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:03 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:37:03 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:04 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c 1G" returned: 0 in 0.426s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:04 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:04 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:04 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.332s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:04 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47 Jul 28 14:37:04 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:04 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:04 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c is being set with open permissions: ugo+rw Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:04 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:04 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:04 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321.c9df5353-5477-419e-8817-1dd76061ef47" returned: 0 in 0.253s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-c9df5353-5477-419e-8817-1dd76061ef47" released by "_delete_snapshot" :: held 1.474s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" released by "delete_snapshot" :: held 1.499s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['b945a584-66f1-4a3d-b1d6-15e93c301663', 'b74dcb30-02df-4b57-8cfd-d79d78a71eba', 'f7bc39b0-6114-4dd6-b785-06dfc53a958a', 'fee862dd-0e95-44e6-8c63-367ca5597906'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Delete snapshot completed successfully. Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-c9df5353-5477-419e-8817-1dd76061ef47-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Snapshots deleted, issuing volume delete {{(pid=87385) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258efc9-cf98-4f48-b2e6-161b4054d08c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:04 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.483s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-fbd6d43b-3587-4aef-a55d-8742be085949 tempest-VolumesSnapshotListTestJSON-689615162 None] Create snapshot completed successfully Jul 28 14:37:04 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:37:04 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:05 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:05 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321 Jul 28 14:37:05 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:05 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-320b84e3-0744-4750-8de8-175719556321" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-320b84e3-0744-4750-8de8-175719556321" released by "delete_volume" :: held 0.692s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['704af731-9ca0-45ac-8bbf-31f05c0283b2', 'b3fd8937-3be2-423f-aa28-4c85a9a2b6dd', 'bb20b8b7-666b-4292-a907-390123e4eb33', '00470492-e425-44db-91dd-735b128788bf'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:05 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:05 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Creating offline snapshot 43d5e7f3-0507-430b-9a0a-2a053a642699 of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880168e-2504-47cc-81dc-7db60086b949]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:05 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:05 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:05 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Deleted volume successfully. Jul 28 14:37:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a8f1f9c-82b2-47ee-af97-e24ae1dd61d4 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-320b84e3-0744-4750-8de8-175719556321-delete_volume" released by "delete_volume" :: held 6.270s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:06 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:06 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 1G Jul 28 14:37:06 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:06 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 1G" returned: 0 in 0.500s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:06 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 Jul 28 14:37:06 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (016b5575-8993-4576-9f28-a29164b33ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0427f3-d81d-4fea-8f95-1292dab70a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0427f3-d81d-4fea-8f95-1292dab70a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-536081539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af413469-e4cd-4de2-9aaf-f7d84a35cec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aa669e4e4648358a419d1aecd292bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:07Z,use_quota=True,user_id='e18a3da5926143d4ae8b8503e452f756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c2ba5-8825-4fd3-a105-973b47221834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c2ba5-8825-4fd3-a105-973b47221834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f33b62-7257-4667-b65f-96a95f344e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f33b62-7257-4667-b65f-96a95f344e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af413469-e4cd-4de2-9aaf-f7d84a35cec7', 'volume_name': 'volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa4948b-e62d-474d-a4de-52544fd3da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa4948b-e62d-474d-a4de-52544fd3da67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab86418-b298-4d3a-bc4f-489fdb629bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Volume af413469-e4cd-4de2-9aaf-f7d84a35cec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7', 'volume_size': 1} Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:06 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:06 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 is being set with open permissions: ugo+rw Jul 28 14:37:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:06 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 Jul 28 14:37:06 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:07 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.543s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-536081539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af413469-e4cd-4de2-9aaf-f7d84a35cec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aa669e4e4648358a419d1aecd292bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:07Z,use_quota=True,user_id='e18a3da5926143d4ae8b8503e452f756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Creating volume af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:07 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 1073741824 Jul 28 14:37:07 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-df8ba3a5-e7ab-4b72-97cf-012cc8c705ed tempest-VolumesSnapshotListTestJSON-689615162 None] Create snapshot completed successfully Jul 28 14:37:07 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 1073741824" returned: 0 in 0.455s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:07 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:07 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:07 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.275s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab86418-b298-4d3a-bc4f-489fdb629bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8baaa0b-dd6e-4929-adff-2e4d87aafd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Volume volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 (af413469-e4cd-4de2-9aaf-f7d84a35cec7): created successfully Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8baaa0b-dd6e-4929-adff-2e4d87aafd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (016b5575-8993-4576-9f28-a29164b33ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-eaaa36cd-78f0-4444-9997-3dc53c8e4e5a tempest-VolumesDeleteCascade-1023724756 None] Created volume successfully. Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-43d5e7f3-0507-430b-9a0a-2a053a642699-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-43d5e7f3-0507-430b-9a0a-2a053a642699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-43d5e7f3-0507-430b-9a0a-2a053a642699" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-43d5e7f3-0507-430b-9a0a-2a053a642699" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Deleting offline snapshot 43d5e7f3-0507-430b-9a0a-2a053a642699 of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] snapshot_file for this snap is: volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b994c3-faff-474a-9bd7-8810d537bb4e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:08 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 Jul 28 14:37:08 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Creating offline snapshot 8c4995ae-acdc-47c9-a708-63eac1ac66ef of volume af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3dc17a-d220-4c7c-bc30-0d587c655e7f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:09 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699" returned: 0 in 0.426s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9201edbc-66a0-45fa-abfb-26940fcb157e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:09 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:09 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:09 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:09 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:09 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.462s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:09 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef 1G Jul 28 14:37:09 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:09 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.474s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:09 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 Jul 28 14:37:09 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:09 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef 1G" returned: 0 in 0.468s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:09 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:09 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:10 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699" returned: 0 in 0.557s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:10 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699 Jul 28 14:37:10 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:10 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:10 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef is being set with open permissions: ugo+rw Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:10 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:10 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:10 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.43d5e7f3-0507-430b-9a0a-2a053a642699" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-43d5e7f3-0507-430b-9a0a-2a053a642699" released by "_delete_snapshot" :: held 1.844s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" released by "delete_snapshot" :: held 1.870s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Created reservations ['9b850d1f-84f1-406d-8dd3-d386e7743386', '1985ff21-4cb4-4db7-af06-13734b094d7d', 'd4414fc1-b23f-4f20-923d-888bdc7e3757', '8e53938b-0a29-4c4d-acdf-09e6e8fdf9f0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:10 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.273s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Delete snapshot completed successfully. Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-37bdec7e-9ddf-4849-8e69-2e3eaa0a3d45 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-43d5e7f3-0507-430b-9a0a-2a053a642699-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:10 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info Jul 28 14:37:10 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-105e9aa8-3581-4f3f-a775-78e7d0361b6c-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-105e9aa8-3581-4f3f-a775-78e7d0361b6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-105e9aa8-3581-4f3f-a775-78e7d0361b6c" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-105e9aa8-3581-4f3f-a775-78e7d0361b6c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Deleting offline snapshot 105e9aa8-3581-4f3f-a775-78e7d0361b6c of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] snapshot_file for this snap is: volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ca5769-1cfd-488b-8d27-575a04ba7935]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:10 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:10 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info is being set with open permissions: ugo+rw Jul 28 14:37:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:10 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:10 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:10 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info Jul 28 14:37:10 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:11 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:11 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.390s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.info" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[604dd3b6-4e93-4c27-b152-47126a749a26]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d0dc4c43-3830-4909-8bc9-be496142c57f tempest-VolumesDeleteCascade-1023724756 None] Create snapshot completed successfully Jul 28 14:37:11 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:11 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:11 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:11 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:11 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:12 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:12 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c Jul 28 14:37:12 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:12 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.105e9aa8-3581-4f3f-a775-78e7d0361b6c" returned: 0 in 0.347s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-105e9aa8-3581-4f3f-a775-78e7d0361b6c" released by "_delete_snapshot" :: held 1.667s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" released by "delete_snapshot" :: held 1.691s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Created reservations ['2c1c7376-442f-4e8b-9599-ec2edce9ca94', '83a0e340-78f2-43e1-8dd8-3640f3bdb4a1', 'f2f7f801-c905-4685-bf0b-205485f81ca0', 'b2837f2a-79da-479e-963c-3196f68a43b3'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Delete snapshot completed successfully. Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e4d4dd82-f899-43f4-bd15-a2bdc406485d tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-105e9aa8-3581-4f3f-a775-78e7d0361b6c-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-9fd9ae34-6559-43fe-baf1-8ac270cab3c9-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (3cde9587-019f-40cb-8f27-9a76a1eaea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcacd04-c933-480c-a118-fdff860ac58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-9fd9ae34-6559-43fe-baf1-8ac270cab3c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efcacd04-c933-480c-a118-fdff860ac58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1607974976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e689e460-bae2-4aab-8596-15fb03a5473d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44aa669e4e4648358a419d1aecd292bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c4995ae-acdc-47c9-a708-63eac1ac66ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:13Z,use_quota=True,user_id='e18a3da5926143d4ae8b8503e452f756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644f41da-35db-4edd-98ab-26b2749f78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644f41da-35db-4edd-98ab-26b2749f78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f69c72-a5a9-479e-8fca-0f01248751c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f69c72-a5a9-479e-8fca-0f01248751c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e689e460-bae2-4aab-8596-15fb03a5473d', 'volume_name': 'volume-e689e460-bae2-4aab-8596-15fb03a5473d', 'volume_size': 1, 'snapshot_id': '8c4995ae-acdc-47c9-a708-63eac1ac66ef'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9319f88-f744-4f1b-bee4-ac9243adf68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9319f88-f744-4f1b-bee4-ac9243adf68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef50c348-ac0b-4b21-929e-2fbfc52e5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Volume e689e460-bae2-4aab-8596-15fb03a5473d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e689e460-bae2-4aab-8596-15fb03a5473d', 'volume_size': 1, 'snapshot_id': '8c4995ae-acdc-47c9-a708-63eac1ac66ef'} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-9fd9ae34-6559-43fe-baf1-8ac270cab3c9" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef-e689e460-bae2-4aab-8596-15fb03a5473d" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-9fd9ae34-6559-43fe-baf1-8ac270cab3c9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Deleting offline snapshot 9fd9ae34-6559-43fe-baf1-8ac270cab3c9 of volume 07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] snapshot_file for this snap is: volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:37:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-a5bb6fa3-8215-408a-89ae-b7791aceaa87 req-128e1658-d312-409e-854b-ff9c4edf8fbe tempest-TestShelveInstance-1980310390 None] Terminate volume connection completed successfully. Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-a5bb6fa3-8215-408a-89ae-b7791aceaa87 req-128e1658-d312-409e-854b-ff9c4edf8fbe tempest-TestShelveInstance-1980310390 None] Deleting attachment 3e13b32e-2dba-4a05-bc41-424675963b31. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d515ad9b-882c-447c-8ee3-2d7200c576d8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef-e689e460-bae2-4aab-8596-15fb03a5473d" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Creating volume e689e460-bae2-4aab-8596-15fb03a5473d from snapshot 8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] snapshot: 8c4995ae-acdc-47c9-a708-63eac1ac66ef, volume: e689e460-bae2-4aab-8596-15fb03a5473d, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd5931-54d7-4286-bbfe-f816261bd74e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:13 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:13 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:13 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:13 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:13 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.474s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07227feb-f702-4120-8c21-924d344b6499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a0590-597f-4c0c-8bd3-033ed7349e2c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:13 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.455s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139153c-0f6c-443f-a0ff-26339267035a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:13 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 Jul 28 14:37:13 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:13 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:13 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:14 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:14 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:14 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:14 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.370s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:14 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d Jul 28 14:37:14 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:14 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.335s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:14 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9 Jul 28 14:37:14 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:14 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499.9fd9ae34-6559-43fe-baf1-8ac270cab3c9" returned: 0 in 0.502s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-9fd9ae34-6559-43fe-baf1-8ac270cab3c9" released by "_delete_snapshot" :: held 1.976s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" released by "delete_snapshot" :: held 2.027s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:15 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Created reservations ['87420261-35b8-4b3e-8d09-36307550cb3d', 'c4f4964b-41e6-4e00-8e15-f00ff37bcdc5', 'c71229ed-e667-454b-999f-eea664fa5652', '81c53eed-8283-4b59-bd82-2dd2fffb56ec'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Delete snapshot completed successfully. Jul 28 14:37:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3f82cc3b-61ae-495c-88b8-b0ea9c6b07b7 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-9fd9ae34-6559-43fe-baf1-8ac270cab3c9-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-07227feb-f702-4120-8c21-924d344b6499-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-07227feb-f702-4120-8c21-924d344b6499-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7558c-6633-4bca-a374-b097577db109]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:17 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 Jul 28 14:37:17 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:18 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499" returned: 0 in 1.194s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:18 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499 Jul 28 14:37:18 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:18 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-07227feb-f702-4120-8c21-924d344b6499" returned: 0 in 0.393s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-quobyte-07227feb-f702-4120-8c21-924d344b6499" released by "delete_volume" :: held 1.728s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Created reservations ['c35c1fd3-a4c2-4b1b-a760-d461fbcc158b', '94a9273d-f20c-468d-b075-cc70ef43f0cd', '445c85bd-8c73-4e6d-93f8-370e7578e55c', '7ce90212-b102-4803-a181-59d9297e224c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-95297a2a-6803-4e4c-8469-635a2c6b57ef req-f5d78953-cbc9-4464-b2f5-3ae060c2d71f tempest-TestShelveInstance-1980310390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:18 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:18 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:19 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d" returned: 0 in 5.062s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd832cab-9e7f-4ce0-8960-de12d113a429]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:19 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.477s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:19 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Deleted volume successfully. Jul 28 14:37:19 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:19 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-99e5a23b-1471-47de-b8e1-e508d8afdd64 tempest-VolumesSnapshotListTestJSON-689615162 None] Lock "cinder-07227feb-f702-4120-8c21-924d344b6499-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:19 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.564s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:37:19 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Converted 1024.00 MB image at 202.20 MB/s Jul 28 14:37:19 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d is being set with open permissions: ugo+rw Jul 28 14:37:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:19 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d Jul 28 14:37:19 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:20 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" released by "_copy_volume_from_snapshot" :: held 6.838s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef-e689e460-bae2-4aab-8596-15fb03a5473d" released by "_create_volume_from_snapshot" :: held 6.869s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.928s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-95297a2a-6803-4e4c-8469-635a2c6b57ef req-f5d78953-cbc9-4464-b2f5-3ae060c2d71f tempest-TestShelveInstance-1980310390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.351s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-95297a2a-6803-4e4c-8469-635a2c6b57ef req-f5d78953-cbc9-4464-b2f5-3ae060c2d71f tempest-TestShelveInstance-1980310390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef50c348-ac0b-4b21-929e-2fbfc52e5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e689e460-bae2-4aab-8596-15fb03a5473d', 'volume_size': 1, 'snapshot_id': '8c4995ae-acdc-47c9-a708-63eac1ac66ef'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1e49e7-daac-4295-91fd-b31fc4cfd459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Volume volume-e689e460-bae2-4aab-8596-15fb03a5473d (e689e460-bae2-4aab-8596-15fb03a5473d): created successfully Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1e49e7-daac-4295-91fd-b31fc4cfd459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Flow 'volume_create_manager' (3cde9587-019f-40cb-8f27-9a76a1eaea32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-95297a2a-6803-4e4c-8469-635a2c6b57ef req-f5d78953-cbc9-4464-b2f5-3ae060c2d71f tempest-TestShelveInstance-1980310390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9aa18c57-9dbd-40e0-bdf9-2740c7322867', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:37:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-df3881c1-d222-4732-a660-43b6ffa8c3ab tempest-VolumesDeleteCascade-1023724756 None] Created volume successfully. Jul 28 14:37:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-95297a2a-6803-4e4c-8469-635a2c6b57ef req-f5d78953-cbc9-4464-b2f5-3ae060c2d71f tempest-TestShelveInstance-1980310390 None] attachment_update completed successfully. Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-af413469-e4cd-4de2-9aaf-f7d84a35cec7-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-af413469-e4cd-4de2-9aaf-f7d84a35cec7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Performing cascade delete. {{(pid=87385) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-8c4995ae-acdc-47c9-a708-63eac1ac66ef-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-8c4995ae-acdc-47c9-a708-63eac1ac66ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Deleting offline snapshot 8c4995ae-acdc-47c9-a708-63eac1ac66ef of volume af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] snapshot_file for this snap is: volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a2c9fe-e65e-4000-bf7c-d59819d9d23a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:21 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:21 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:21 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.454s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[71735c0c-bce3-4a40-aec2-f11eda4aed7f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:21 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:21 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:21 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:22 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:22 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:22 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.451s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:22 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef Jul 28 14:37:22 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:22 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7.8c4995ae-acdc-47c9-a708-63eac1ac66ef" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-8c4995ae-acdc-47c9-a708-63eac1ac66ef" released by "_delete_snapshot" :: held 1.699s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" released by "delete_snapshot" :: held 1.726s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['980910af-2114-424b-bcb6-f2a7c79df3cf', '31ba1723-0c68-4075-bf1e-94c022668beb', '50b7da9b-079e-4974-a133-9d32e233a380', '62dcb72c-2c6f-43c5-bbf3-d4d612cdab6f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Delete snapshot completed successfully. Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-8c4995ae-acdc-47c9-a708-63eac1ac66ef-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Snapshots deleted, issuing volume delete {{(pid=87385) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da3392-92c2-4058-895f-fe3406e967d9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:23 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:23 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:23 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.700s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:23 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7 Jul 28 14:37:23 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:24 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af413469-e4cd-4de2-9aaf-f7d84a35cec7" returned: 0 in 0.449s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-af413469-e4cd-4de2-9aaf-f7d84a35cec7" released by "delete_volume" :: held 1.282s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['4fd6becd-f4cd-48ad-b5aa-430801e79595', 'b2bbfe68-c6ba-47cb-aa2d-3b611c10ae5d', '881d7752-cc71-4966-b78e-6217d66ee848', 'c18b7be6-f611-4f68-bd69-08dcfd11835c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:24 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:24 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:24 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.252s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Deleted volume successfully. Jul 28 14:37:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c5f403d-0e20-4c76-a108-1cab13eaa21e tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-af413469-e4cd-4de2-9aaf-f7d84a35cec7-delete_volume" released by "delete_volume" :: held 3.861s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-e689e460-bae2-4aab-8596-15fb03a5473d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-e689e460-bae2-4aab-8596-15fb03a5473d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f978b667-ac6f-4d72-a1f1-1622fc5d76c3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:25 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d Jul 28 14:37:25 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:26 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d" returned: 0 in 0.429s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:26 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d Jul 28 14:37:26 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:26 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e689e460-bae2-4aab-8596-15fb03a5473d" returned: 0 in 0.467s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-quobyte-e689e460-bae2-4aab-8596-15fb03a5473d" released by "delete_volume" :: held 0.977s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Created reservations ['6c5e15ca-3a09-48d2-8bd4-7f0edd401d48', '2dddc295-8afc-4a73-b09a-b1e5f9741bad', '21e4dbff-e105-4001-99e3-795efb671f77', 'a22e37d7-1a26-4ccb-ad66-fd1c26dd1301'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:26 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:26 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:27 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:27 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Deleted volume successfully. Jul 28 14:37:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2be18925-6dd7-4769-9112-1359d3f70227 tempest-VolumesDeleteCascade-1023724756 None] Lock "cinder-e689e460-bae2-4aab-8596-15fb03a5473d-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Flow 'volume_create_manager' (f57303af-fd04-4c66-80ec-0f5a83d003f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9563846-8703-4cc8-933c-8d4bf6f82932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9563846-8703-4cc8-933c-8d4bf6f82932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1047246920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d5316c-ae39-4668-a1b5-9d3386c40b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acb22059aa441b780d6363bf85b888a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:32Z,use_quota=True,user_id='c9b2eb90b9144f6fb5a39e36842d982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bfefd3-2ef5-41e3-9d6e-1dd40c948426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bfefd3-2ef5-41e3-9d6e-1dd40c948426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a9830-f114-4a16-bbb4-54cf68144cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a9830-f114-4a16-bbb4-54cf68144cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d5316c-ae39-4668-a1b5-9d3386c40b27', 'volume_name': 'volume-84d5316c-ae39-4668-a1b5-9d3386c40b27', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525edac3-c116-4737-a783-8dccabe0beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525edac3-c116-4737-a783-8dccabe0beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df1cbd-52da-4a47-a3aa-06bb02ee755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Volume 84d5316c-ae39-4668-a1b5-9d3386c40b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d5316c-ae39-4668-a1b5-9d3386c40b27', 'volume_size': 1} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1047246920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d5316c-ae39-4668-a1b5-9d3386c40b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9acb22059aa441b780d6363bf85b888a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:32Z,use_quota=True,user_id='c9b2eb90b9144f6fb5a39e36842d982c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Creating volume 84d5316c-ae39-4668-a1b5-9d3386c40b27 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:31 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:31 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 1073741824 Jul 28 14:37:31 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:32 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 1073741824" returned: 0 in 0.486s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:32 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 Jul 28 14:37:32 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:32 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27" returned: 0 in 0.315s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df1cbd-52da-4a47-a3aa-06bb02ee755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d5316c-ae39-4668-a1b5-9d3386c40b27', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb0a1b9-1aa6-4d04-8579-8287c63ef237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Volume volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 (84d5316c-ae39-4668-a1b5-9d3386c40b27): created successfully Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb0a1b9-1aa6-4d04-8579-8287c63ef237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Flow 'volume_create_manager' (f57303af-fd04-4c66-80ec-0f5a83d003f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-762c3c60-ff2f-45fc-a7e4-29dabc454f7d tempest-VolumesMetadataTest-1741981861 None] Created volume successfully. Jul 28 14:37:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Acquiring lock "cinder-84d5316c-ae39-4668-a1b5-9d3386c40b27-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "cinder-84d5316c-ae39-4668-a1b5-9d3386c40b27-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Acquiring lock "cinder-quobyte-84d5316c-ae39-4668-a1b5-9d3386c40b27" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "cinder-quobyte-84d5316c-ae39-4668-a1b5-9d3386c40b27" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29bb40-02eb-4ad7-a96e-a818529ed3fa]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:35 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 Jul 28 14:37:35 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:35 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27" returned: 0 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:35 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27 Jul 28 14:37:35 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:35 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-84d5316c-ae39-4668-a1b5-9d3386c40b27" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "cinder-quobyte-84d5316c-ae39-4668-a1b5-9d3386c40b27" released by "delete_volume" :: held 0.825s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Created reservations ['dad62337-a807-4dbf-a893-d164329ff901', '184566e4-1031-438d-aaf6-10d3a528402b', '14f5a3ac-0172-4384-ba00-46de71a2b58e', '1e012573-b030-4fe3-82f0-435d66aea04e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:36 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:36 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:36 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Deleted volume successfully. Jul 28 14:37:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-26dc36af-2897-4f04-a94e-6f111dd20ed6 tempest-VolumesMetadataTest-1741981861 None] Lock "cinder-84d5316c-ae39-4668-a1b5-9d3386c40b27-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Flow 'volume_create_manager' (1d249908-b8db-46bd-9d88-49ef324583ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca96fb5-58ed-4d74-98a0-314d04d12e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca96fb5-58ed-4d74-98a0-314d04d12e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1691673739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce5f306-945a-4286-ad6b-81d7233030a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab513c02d65f4f599252d952177aef47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:41Z,use_quota=True,user_id='0daa7188baec44b791fdd087b7f4b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a485ace4-0b0a-4115-b9bc-014b457f802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a485ace4-0b0a-4115-b9bc-014b457f802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737e0a0-e9fd-48e8-82c0-731cd245fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737e0a0-e9fd-48e8-82c0-731cd245fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce5f306-945a-4286-ad6b-81d7233030a8', 'volume_name': 'volume-0ce5f306-945a-4286-ad6b-81d7233030a8', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c7fa88-034b-43b7-b7a8-af4ce0bcbe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c7fa88-034b-43b7-b7a8-af4ce0bcbe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff45d9d-6434-4a46-b03a-682f7178af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:41 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Volume 0ce5f306-945a-4286-ad6b-81d7233030a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce5f306-945a-4286-ad6b-81d7233030a8', 'volume_size': 1} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1691673739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce5f306-945a-4286-ad6b-81d7233030a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab513c02d65f4f599252d952177aef47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:41Z,use_quota=True,user_id='0daa7188baec44b791fdd087b7f4b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Creating volume 0ce5f306-945a-4286-ad6b-81d7233030a8 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:41 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:41 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 1073741824 Jul 28 14:37:41 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:41 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 1073741824" returned: 0 in 0.528s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:42 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 Jul 28 14:37:42 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:42 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8" returned: 0 in 0.292s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff45d9d-6434-4a46-b03a-682f7178af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce5f306-945a-4286-ad6b-81d7233030a8', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb723d1-9ceb-4ed3-9919-751aac1d3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Volume volume-0ce5f306-945a-4286-ad6b-81d7233030a8 (0ce5f306-945a-4286-ad6b-81d7233030a8): created successfully Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb723d1-9ceb-4ed3-9919-751aac1d3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Flow 'volume_create_manager' (1d249908-b8db-46bd-9d88-49ef324583ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e1ba5845-4aa1-4a88-b257-aa217485576c tempest-VolumesTransfersV357Test-492596011 None] Created volume successfully. Jul 28 14:37:44 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-7f1b1f44-438c-46e7-ba4d-3e43dbd4c9a0 tempest-VolumesTransfersV357Test-1303017256 None] Transfer volume completed successfully. Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "cinder-0ce5f306-945a-4286-ad6b-81d7233030a8-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-0ce5f306-945a-4286-ad6b-81d7233030a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "cinder-quobyte-0ce5f306-945a-4286-ad6b-81d7233030a8" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-quobyte-0ce5f306-945a-4286-ad6b-81d7233030a8" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c03b3-8315-4312-a89a-7793930077a0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:44 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 Jul 28 14:37:44 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:45 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8" returned: 0 in 0.410s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:45 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8 Jul 28 14:37:45 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:45 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0ce5f306-945a-4286-ad6b-81d7233030a8" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-quobyte-0ce5f306-945a-4286-ad6b-81d7233030a8" released by "delete_volume" :: held 0.762s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Created reservations ['3e4e4d8e-1a1e-44be-aaf5-0b93849d9b93', 'b59cd59b-ce1f-48e0-8f97-1ab87f24a284', '2d7d2764-88de-41a0-9384-2f0cab337488', '9f7a3e94-7f7a-49dd-86e7-6ad2220778f7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:45 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:45 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:45 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Deleted volume successfully. Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-094d4f03-91f5-48e9-bab4-59f612bb0b85 tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-0ce5f306-945a-4286-ad6b-81d7233030a8-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Flow 'volume_create_manager' (03afa8c2-5583-4a65-88a3-02ee53cca6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39962d4-153f-4ef6-8230-bda266195021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39962d4-153f-4ef6-8230-bda266195021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243136946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093c650-3af5-4558-8102-d11be6db6a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ef660c591f4fbdb15ec2223e89d38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='f98f7c7f8bcc46adab9eed117d227986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3aa599-8a53-40c1-88eb-f4e924c47049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3aa599-8a53-40c1-88eb-f4e924c47049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ca6654-630e-4792-a1a1-4301d1b722fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ca6654-630e-4792-a1a1-4301d1b722fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f093c650-3af5-4558-8102-d11be6db6a48', 'volume_name': 'volume-f093c650-3af5-4558-8102-d11be6db6a48', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6982c6-ea3c-4901-8b87-6d2b68d1e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6982c6-ea3c-4901-8b87-6d2b68d1e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ee8cc7-4f6e-4633-8149-56b758818c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume f093c650-3af5-4558-8102-d11be6db6a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f093c650-3af5-4558-8102-d11be6db6a48', 'volume_size': 1} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243136946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093c650-3af5-4558-8102-d11be6db6a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ef660c591f4fbdb15ec2223e89d38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='f98f7c7f8bcc46adab9eed117d227986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Creating volume f093c650-3af5-4558-8102-d11be6db6a48 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:45 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:46 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 1073741824 Jul 28 14:37:46 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Flow 'volume_create_manager' (8b1b64a2-0b2a-4a3c-ae75-59721c550abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3b793b-66cd-4373-9ed1-8e8fd48692ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Flow 'volume_create_manager' (d7d707cf-bb67-4a0d-acc4-6ed79b67d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b930dd1-1198-4b7b-b776-fe576bc2c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3b793b-66cd-4373-9ed1-8e8fd48692ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1211713900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d558ec14-5305-4f3f-b8f1-86d99a0ec02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab513c02d65f4f599252d952177aef47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='0daa7188baec44b791fdd087b7f4b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c4472-1409-4619-afd0-a05da06ed4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0c4472-1409-4619-afd0-a05da06ed4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4805ca33-9901-4503-82ce-fce7651c68d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4805ca33-9901-4503-82ce-fce7651c68d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd558ec14-5305-4f3f-b8f1-86d99a0ec02a', 'volume_name': 'volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b419a2a-fb09-42af-b7f1-e93d9feedc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b419a2a-fb09-42af-b7f1-e93d9feedc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da4b9e0-1c2a-4721-8362-a3f2be447087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Volume d558ec14-5305-4f3f-b8f1-86d99a0ec02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a', 'volume_size': 1} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 1073741824" returned: 0 in 0.629s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b930dd1-1198-4b7b-b776-fe576bc2c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027899599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70b03d6-91da-4301-94fe-2828e89bcf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ef660c591f4fbdb15ec2223e89d38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='f98f7c7f8bcc46adab9eed117d227986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b1ec9e-6455-48db-a011-f1611441ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b1ec9e-6455-48db-a011-f1611441ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3990e7-1664-495d-b112-ed681090b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3990e7-1664-495d-b112-ed681090b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70b03d6-91da-4301-94fe-2828e89bcf7b', 'volume_name': 'volume-c70b03d6-91da-4301-94fe-2828e89bcf7b', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd623d0-8d45-4d4d-a665-f98a6b66e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd623d0-8d45-4d4d-a665-f98a6b66e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2150d394-77ca-4c74-99c3-1b91fea40c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume c70b03d6-91da-4301-94fe-2828e89bcf7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70b03d6-91da-4301-94fe-2828e89bcf7b', 'volume_size': 1} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:46 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 Jul 28 14:37:46 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:46 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1211713900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d558ec14-5305-4f3f-b8f1-86d99a0ec02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab513c02d65f4f599252d952177aef47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='0daa7188baec44b791fdd087b7f4b862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Creating volume d558ec14-5305-4f3f-b8f1-86d99a0ec02a {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:46 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ee8cc7-4f6e-4633-8149-56b758818c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f093c650-3af5-4558-8102-d11be6db6a48', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b9d40e-006b-41a6-bcea-27d5a514a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:47 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a 1073741824 Jul 28 14:37:47 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:47 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume volume-f093c650-3af5-4558-8102-d11be6db6a48 (f093c650-3af5-4558-8102-d11be6db6a48): created successfully Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b9d40e-006b-41a6-bcea-27d5a514a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Flow 'volume_create_manager' (03afa8c2-5583-4a65-88a3-02ee53cca6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-45efcbbf-8858-4eee-b508-807081332e61 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Created volume successfully. Jul 28 14:37:47 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a 1073741824" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:47 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a Jul 28 14:37:47 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:47 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027899599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70b03d6-91da-4301-94fe-2828e89bcf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ef660c591f4fbdb15ec2223e89d38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:37:46Z,use_quota=True,user_id='f98f7c7f8bcc46adab9eed117d227986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Creating volume c70b03d6-91da-4301-94fe-2828e89bcf7b {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:37:47 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:47 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b 1073741824 Jul 28 14:37:47 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da4b9e0-1c2a-4721-8362-a3f2be447087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10502b3-b30f-45c2-bf99-8dd85741456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:47 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Volume volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a (d558ec14-5305-4f3f-b8f1-86d99a0ec02a): created successfully Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10502b3-b30f-45c2-bf99-8dd85741456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Flow 'volume_create_manager' (8b1b64a2-0b2a-4a3c-ae75-59721c550abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9fe082d0-fa02-403e-94e6-a46ba94ad65f tempest-VolumesTransfersV357Test-492596011 None] Created volume successfully. Jul 28 14:37:48 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b 1073741824" returned: 0 in 0.558s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:48 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b Jul 28 14:37:48 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "cinder-d558ec14-5305-4f3f-b8f1-86d99a0ec02a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:48 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b" returned: 0 in 0.371s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-d558ec14-5305-4f3f-b8f1-86d99a0ec02a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2150d394-77ca-4c74-99c3-1b91fea40c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70b03d6-91da-4301-94fe-2828e89bcf7b', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe58b21-9a19-47b3-8f68-a63932fd3f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "cinder-quobyte-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:48 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Volume volume-c70b03d6-91da-4301-94fe-2828e89bcf7b (c70b03d6-91da-4301-94fe-2828e89bcf7b): created successfully Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe58b21-9a19-47b3-8f68-a63932fd3f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Flow 'volume_create_manager' (d7d707cf-bb67-4a0d-acc4-6ed79b67d656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:37:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ad734980-9944-4df6-9274-7dd51b98ee6f tempest-TestServerVolumeAttachmentScenario-1776491183 None] Created volume successfully. Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-quobyte-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" acquired by "delete_volume" :: waited 0.048s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bd93dd-61f8-48ad-9fd8-057a1fd91f4c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:49 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a Jul 28 14:37:49 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:49 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:49 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:49 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" returned: 0 in 0.513s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:49 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a Jul 28 14:37:49 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:49 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:37:49 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" returned: 0 in 0.292s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-quobyte-d558ec14-5305-4f3f-b8f1-86d99a0ec02a" released by "delete_volume" :: held 0.851s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Created reservations ['41c242ef-f7d2-4dd5-98ba-26994584b8e1', 'ac270c25-caa9-4a5e-a18e-366f2985394b', 'ebcf86ef-426a-4fed-9a0c-b81bd88a666e', 'a53c0360-9730-4900-b377-4bf1dfb82cc3'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:49 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:49 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:50 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:50 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:50 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Deleted volume successfully. Jul 28 14:37:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8daaa28f-32d7-4701-9cd8-bd06a9b0219a tempest-VolumesTransfersV357Test-1747036505 None] Lock "cinder-d558ec14-5305-4f3f-b8f1-86d99a0ec02a-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-e7d7bc78-81d0-4cae-94bc-ad811b1ad03a tempest-TestShelveInstance-1980310390 None] Terminate volume connection completed successfully. Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-e7d7bc78-81d0-4cae-94bc-ad811b1ad03a tempest-TestShelveInstance-1980310390 None] Deleting attachment 9aa18c57-9dbd-40e0-bdf9-2740c7322867. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Acquiring lock "cinder-951b7009-c2eb-4d46-ace7-410ca4fd43e9-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "cinder-951b7009-c2eb-4d46-ace7-410ca4fd43e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Acquiring lock "cinder-quobyte-951b7009-c2eb-4d46-ace7-410ca4fd43e9" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "cinder-quobyte-951b7009-c2eb-4d46-ace7-410ca4fd43e9" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b929e33c-c70e-43ce-9c60-51eff78c28eb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:37:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:54 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 Jul 28 14:37:54 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:55 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9" returned: 0 in 0.890s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:55 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9 Jul 28 14:37:55 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:55 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-951b7009-c2eb-4d46-ace7-410ca4fd43e9" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "cinder-quobyte-951b7009-c2eb-4d46-ace7-410ca4fd43e9" released by "delete_volume" :: held 1.403s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:37:55 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=98,cinder:DELETE=12,cinder:UPDATE=121,cinder:INSERT=29 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=121,cinder:UPDATE=122,cinder:INSERT=33,cinder:DELETE=9 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG cinder.quota [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Created reservations ['eab84081-794f-4594-9723-04afb97fbebf', '2a1aaebf-cd1a-4ef0-a4e3-f32c78ab9490', '847e2970-ffdf-4322-9f7d-9ba3ce8c3d38', '9b3c852d-0bf8-471c-9769-833a7cc246ea'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:37:56 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:37:56 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:37:56 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.371s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG cinder.manager [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:37:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Deleted volume successfully. Jul 28 14:37:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [req-85ade22a-5055-4245-b637-08ad47d7aab7 req-3b0d6a8d-1075-49da-baa7-0a55b5ad10a3 tempest-TestShelveInstance-1980310390 None] Lock "cinder-951b7009-c2eb-4d46-ace7-410ca4fd43e9-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:06 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:38:06 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:INSERT=2,cinder:UPDATE=7,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Flow 'volume_create_manager' (defab2f2-bfbf-405b-aa33-6e013a84b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806ea87b-49f7-432e-a55c-311140ef6617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806ea87b-49f7-432e-a55c-311140ef6617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641255469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03271d23-2d3f-4fb1-a484-9a681b35c60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373987f3ab294c49a3b24ceafa7c0e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:11Z,use_quota=True,user_id='6725f3576e66469aa2e841f22799b925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311bb32-13e8-4d2c-b9ab-21fce55b987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f311bb32-13e8-4d2c-b9ab-21fce55b987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1e43d2-9de8-46fb-89ec-6f8081f87575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1e43d2-9de8-46fb-89ec-6f8081f87575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03271d23-2d3f-4fb1-a484-9a681b35c60f', 'volume_name': 'volume-03271d23-2d3f-4fb1-a484-9a681b35c60f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0ad13e-ca35-4e21-a4ed-54e11515dcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0ad13e-ca35-4e21-a4ed-54e11515dcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dba223f-2698-41c9-9477-4617622f3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Volume 03271d23-2d3f-4fb1-a484-9a681b35c60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03271d23-2d3f-4fb1-a484-9a681b35c60f', 'volume_size': 1} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641255469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03271d23-2d3f-4fb1-a484-9a681b35c60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373987f3ab294c49a3b24ceafa7c0e4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:11Z,use_quota=True,user_id='6725f3576e66469aa2e841f22799b925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Creating volume 03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:10 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:10 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f 1073741824 Jul 28 14:38:10 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:11 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f 1073741824" returned: 0 in 0.446s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:11 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:38:11 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:11 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dba223f-2698-41c9-9477-4617622f3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03271d23-2d3f-4fb1-a484-9a681b35c60f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec924947-372c-4e49-9a18-a249c21258f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:11 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Volume volume-03271d23-2d3f-4fb1-a484-9a681b35c60f (03271d23-2d3f-4fb1-a484-9a681b35c60f): created successfully Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec924947-372c-4e49-9a18-a249c21258f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Flow 'volume_create_manager' (defab2f2-bfbf-405b-aa33-6e013a84b229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b376d1b8-2393-464a-bfaf-befaa0c8c344 tempest-VolumesActionsTest-5919707 None] Created volume successfully. Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (197c856a-3e98-444b-9dda-89756b297d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b536049-4db0-42c6-8ebb-9a31fee43f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b536049-4db0-42c6-8ebb-9a31fee43f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835682583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424121ca-8e72-4dcd-9fdc-51943a12fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:12Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca745b8-a92c-474b-a63a-2b443451c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca745b8-a92c-474b-a63a-2b443451c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2137fe06-50bf-4748-8c30-cd001a65e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2137fe06-50bf-4748-8c30-cd001a65e476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424121ca-8e72-4dcd-9fdc-51943a12fc25', 'volume_name': 'volume-424121ca-8e72-4dcd-9fdc-51943a12fc25', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22acd769-d4d1-47c7-987b-677889a4696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22acd769-d4d1-47c7-987b-677889a4696a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8395224-920e-4077-bf5c-e77b138389ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume 424121ca-8e72-4dcd-9fdc-51943a12fc25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424121ca-8e72-4dcd-9fdc-51943a12fc25', 'volume_size': 1} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835682583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424121ca-8e72-4dcd-9fdc-51943a12fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:12Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume 424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:12 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:12 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 1073741824 Jul 28 14:38:12 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:12 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 1073741824" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:12 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 Jul 28 14:38:12 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:12 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8395224-920e-4077-bf5c-e77b138389ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424121ca-8e72-4dcd-9fdc-51943a12fc25', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6855b-5194-4740-9541-e3db48f543a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 (424121ca-8e72-4dcd-9fdc-51943a12fc25): created successfully Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6855b-5194-4740-9541-e3db48f543a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (197c856a-3e98-444b-9dda-89756b297d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ccc7470d-7703-417b-80ff-35eb7c310c32 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating offline snapshot 06fd86a3-c4e7-4803-afb5-95cbeb41194c of volume 424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f144f9-d467-4cac-8b36-f355094a672b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:13 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 Jul 28 14:38:13 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:13 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:13 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c 1G Jul 28 14:38:13 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:14 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c 1G" returned: 0 in 0.452s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:14 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c Jul 28 14:38:14 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:14 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c" returned: 0 in 0.308s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:14 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c is being set with open permissions: ugo+rw Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:14 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c Jul 28 14:38:14 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:14 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:14 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info Jul 28 14:38:14 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:14 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:14 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info is being set with open permissions: ugo+rw Jul 28 14:38:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:14 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info Jul 28 14:38:14 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:15 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.info" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-93c0c85a-3376-4aaa-8cbb-1ef90773772d tempest-CreateVolumesFromSnapshotTest-516146953 None] Create snapshot completed successfully Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (51685fcb-1ecb-417a-bbd9-a2e68bf94bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b907bb3a-5250-41ff-899a-f46b1cb61e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b907bb3a-5250-41ff-899a-f46b1cb61e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636654452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f56a18-cd1d-4ce1-a480-966ff3c3fddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:17Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8a9ee4-bf01-4734-a47f-dab4173d9cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8a9ee4-bf01-4734-a47f-dab4173d9cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55d812c-65e4-4c6c-9cc3-766cf4c472d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55d812c-65e4-4c6c-9cc3-766cf4c472d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f56a18-cd1d-4ce1-a480-966ff3c3fddd', 'volume_name': 'volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e892ce8-1ee7-4092-84da-11fe6b3ed423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e892ce8-1ee7-4092-84da-11fe6b3ed423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ae1de8-ea35-49bf-95bf-2bfa240a36d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:16 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume 78f56a18-cd1d-4ce1-a480-966ff3c3fddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd', 'volume_size': 1} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-636654452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f56a18-cd1d-4ce1-a480-966ff3c3fddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:17Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume 78f56a18-cd1d-4ce1-a480-966ff3c3fddd {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:16 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:16 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd 1073741824 Jul 28 14:38:16 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (05e2917b-8b68-442b-b3eb-8a4a56832ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587dbad1-d6b5-42bd-ac29-f3d8c96d6fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587dbad1-d6b5-42bd-ac29-f3d8c96d6fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090726082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:17Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb74d56-fb8b-4636-8fc5-8b88a201f689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb74d56-fb8b-4636-8fc5-8b88a201f689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f3145e-b12c-4563-b962-ee370a29457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f3145e-b12c-4563-b962-ee370a29457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76', 'volume_name': 'volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dd7315-5ab7-4fff-898b-c8ba7d2420d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13dd7315-5ab7-4fff-898b-c8ba7d2420d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6142f65-1b96-4933-9828-89438f8ab4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:17 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76', 'volume_size': 1} Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:17 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd 1073741824" returned: 0 in 1.009s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (ee9242a5-9cc8-46df-b193-b58774ae6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d03b54-5c06-4a78-b501-815ab02a04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d03b54-5c06-4a78-b501-815ab02a04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335976479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:18Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd Jul 28 14:38:18 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc93214-fe8c-46f2-a73b-7da5484224dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc93214-fe8c-46f2-a73b-7da5484224dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be7ead0-dcb5-4716-a3a5-37bb3d051a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be7ead0-dcb5-4716-a3a5-37bb3d051a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5', 'volume_name': 'volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911275b6-16b6-4a75-9b48-56f847d5588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911275b6-16b6-4a75-9b48-56f847d5588f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efa0c53-536f-49ea-8ed5-a75a2b6c8b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume 3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5', 'volume_size': 1} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:18 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" returned: 0 in 0.460s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090726082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:17Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:18 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:18 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 1073741824 Jul 28 14:38:18 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ae1de8-ea35-49bf-95bf-2bfa240a36d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6f1e36-cc26-4d87-9cd2-541243ced190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:18 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd (78f56a18-cd1d-4ce1-a480-966ff3c3fddd): created successfully Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6f1e36-cc26-4d87-9cd2-541243ced190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (51685fcb-1ecb-417a-bbd9-a2e68bf94bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:18 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e1c008af-04b0-4530-b5ef-27ab0ddf258f tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (8f7ebcad-cb8c-4f1a-b4cc-1c817a5504f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e73623-735d-4d2b-b0ce-0f0dc8f34d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e73623-735d-4d2b-b0ce-0f0dc8f34d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925675653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd03cc04-b862-4bde-a024-7cf9ee139499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:19Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5ee3b5-a76d-44eb-8198-e63fd841b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5ee3b5-a76d-44eb-8198-e63fd841b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccebdb12-ada6-4b35-afc8-9e118c2129e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccebdb12-ada6-4b35-afc8-9e118c2129e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd03cc04-b862-4bde-a024-7cf9ee139499', 'volume_name': 'volume-fd03cc04-b862-4bde-a024-7cf9ee139499', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77b5ab0-7982-4301-8605-05b0ddfb852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77b5ab0-7982-4301-8605-05b0ddfb852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9af6bdb-34f3-484b-8e8f-af2de5fc9e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume fd03cc04-b862-4bde-a024-7cf9ee139499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd03cc04-b862-4bde-a024-7cf9ee139499', 'volume_size': 1} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:19 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 1073741824" returned: 0 in 1.007s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:19 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 Jul 28 14:38:19 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (62f63222-ce2c-429d-8cab-43b969e06013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34731e30-4b53-4b76-944f-c60ae2dd3ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34731e30-4b53-4b76-944f-c60ae2dd3ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-258709273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af30446-6dc3-43e6-be81-d95d9d679f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:20Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e397078e-a8f6-4338-851c-479ab028a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e397078e-a8f6-4338-851c-479ab028a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16484844-4a05-4504-9910-7ef2a8365e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16484844-4a05-4504-9910-7ef2a8365e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af30446-6dc3-43e6-be81-d95d9d679f6a', 'volume_name': 'volume-7af30446-6dc3-43e6-be81-d95d9d679f6a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe966da-0d1b-4091-840a-fb3e9f06528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe966da-0d1b-4091-840a-fb3e9f06528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcba87f3-b755-4b2e-b7ac-8446e075ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:19 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume 7af30446-6dc3-43e6-be81-d95d9d679f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af30446-6dc3-43e6-be81-d95d9d679f6a', 'volume_size': 1} Jul 28 14:38:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:20 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335976479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:18Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume 3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6142f65-1b96-4933-9828-89438f8ab4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40b1f7c-b96e-418c-be87-23d2113cd6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:20 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 1073741824 Jul 28 14:38:20 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 (caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76): created successfully Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40b1f7c-b96e-418c-be87-23d2113cd6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (05e2917b-8b68-442b-b3eb-8a4a56832ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-74f1a648-7504-40e3-8a19-196b032ee964 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:20 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 1073741824" returned: 0 in 0.468s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:20 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 Jul 28 14:38:20 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:20 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925675653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd03cc04-b862-4bde-a024-7cf9ee139499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:19Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume fd03cc04-b862-4bde-a024-7cf9ee139499 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efa0c53-536f-49ea-8ed5-a75a2b6c8b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52570945-b603-4ec0-9c41-bca7fc7e6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 (3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5): created successfully Jul 28 14:38:21 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 1073741824 Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52570945-b603-4ec0-9c41-bca7fc7e6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (ee9242a5-9cc8-46df-b193-b58774ae6a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:21 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e179820d-7dd4-436c-a7a7-784baa7d5ee8 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:21 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 1073741824" returned: 0 in 0.569s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:21 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 Jul 28 14:38:21 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:21 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-258709273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af30446-6dc3-43e6-be81-d95d9d679f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6124e93704bc4bf987ffd58f21bcb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:20Z,use_quota=True,user_id='1d320414054f4ea381ff36baf9837d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Creating volume 7af30446-6dc3-43e6-be81-d95d9d679f6a {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:38:21 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9af6bdb-34f3-484b-8e8f-af2de5fc9e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd03cc04-b862-4bde-a024-7cf9ee139499', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:21 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a 1073741824 Jul 28 14:38:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb81484-94cb-43d8-89ad-e98483ad4643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:21 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-fd03cc04-b862-4bde-a024-7cf9ee139499 (fd03cc04-b862-4bde-a024-7cf9ee139499): created successfully Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb81484-94cb-43d8-89ad-e98483ad4643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (8f7ebcad-cb8c-4f1a-b4cc-1c817a5504f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ce09b6bf-b9d3-4553-a211-d40b063fdf9c tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2121ae5d-a609-4491-a0b3-ad80c9f12868 tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" by "attach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2121ae5d-a609-4491-a0b3-ad80c9f12868 tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" acquired by "attach_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2121ae5d-a609-4491-a0b3-ad80c9f12868 tempest-VolumesActionsTest-5919707 None] Attaching volume 03271d23-2d3f-4fb1-a484-9a681b35c60f to instance 6f26f007-5b0c-454a-8a12-4cc00dc0ecec at mountpoint /dev/vdb on host None. Jul 28 14:38:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2121ae5d-a609-4491-a0b3-ad80c9f12868 tempest-VolumesActionsTest-5919707 None] Attach volume completed successfully. Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2121ae5d-a609-4491-a0b3-ad80c9f12868 tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" released by "attach_volume" :: held 0.110s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-19ad9735-34a9-4a7f-8324-f2e41b57e47e tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" by "detach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-19ad9735-34a9-4a7f-8324-f2e41b57e47e tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:22 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-19ad9735-34a9-4a7f-8324-f2e41b57e47e tempest-VolumesActionsTest-5919707 None] Detaching volume 03271d23-2d3f-4fb1-a484-9a681b35c60f from instance 6f26f007-5b0c-454a-8a12-4cc00dc0ecec. Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a 1073741824" returned: 0 in 0.798s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-19ad9735-34a9-4a7f-8324-f2e41b57e47e tempest-VolumesActionsTest-5919707 None] Detach volume completed successfully. Jul 28 14:38:22 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a Jul 28 14:38:22 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-19ad9735-34a9-4a7f-8324-f2e41b57e47e tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:23 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcba87f3-b755-4b2e-b7ac-8446e075ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af30446-6dc3-43e6-be81-d95d9d679f6a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50551df5-9673-44bc-8c45-e6f538530c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:23 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Volume volume-7af30446-6dc3-43e6-be81-d95d9d679f6a (7af30446-6dc3-43e6-be81-d95d9d679f6a): created successfully Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50551df5-9673-44bc-8c45-e6f538530c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Flow 'volume_create_manager' (62f63222-ce2c-429d-8cab-43b969e06013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e9eed1a4-0b67-461c-8e5e-4250796b14b5 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created volume successfully. Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-7af30446-6dc3-43e6-be81-d95d9d679f6a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-7af30446-6dc3-43e6-be81-d95d9d679f6a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-7af30446-6dc3-43e6-be81-d95d9d679f6a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-7af30446-6dc3-43e6-be81-d95d9d679f6a" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8732bb2e-9fd8-45d9-bfb3-e7182d811c01]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d34e3e69-6ad9-487f-bb2b-c0f0c0fc71a7 req-39ddb401-a264-4216-b476-71d27b085c1c tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d34e3e69-6ad9-487f-bb2b-c0f0c0fc71a7 req-39ddb401-a264-4216-b476-71d27b085c1c tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-d34e3e69-6ad9-487f-bb2b-c0f0c0fc71a7 req-39ddb401-a264-4216-b476-71d27b085c1c tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-d34e3e69-6ad9-487f-bb2b-c0f0c0fc71a7 req-39ddb401-a264-4216-b476-71d27b085c1c tempest-TestServerVolumeAttachmentScenario-1776491183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-f093c650-3af5-4558-8102-d11be6db6a48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea918786-66dc-4a48-9609-0a7f380777da', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:38:23 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a Jul 28 14:38:23 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-d34e3e69-6ad9-487f-bb2b-c0f0c0fc71a7 req-39ddb401-a264-4216-b476-71d27b085c1c tempest-TestServerVolumeAttachmentScenario-1776491183 None] attachment_update completed successfully. Jul 28 14:38:24 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a" returned: 0 in 0.580s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:24 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a Jul 28 14:38:24 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:24 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7af30446-6dc3-43e6-be81-d95d9d679f6a" returned: 0 in 0.312s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-7af30446-6dc3-43e6-be81-d95d9d679f6a" released by "delete_volume" :: held 0.953s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['1853af37-6ecc-4b12-9099-cfafba2ac882', 'f88e2494-ebc3-4d9b-9bbe-b22b93404393', '9cf77605-db76-4266-93eb-6049103d85f8', '86048a1c-93cf-4bf4-be72-02bb0dc29287'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:24 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:24 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:25 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.340s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c9b97646-b176-433b-8138-ed273557a241 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-7af30446-6dc3-43e6-be81-d95d9d679f6a-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-fd03cc04-b862-4bde-a024-7cf9ee139499-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-fd03cc04-b862-4bde-a024-7cf9ee139499-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-fd03cc04-b862-4bde-a024-7cf9ee139499" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-fd03cc04-b862-4bde-a024-7cf9ee139499" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d833a-879a-421c-bec0-0da389446f30]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:26 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 Jul 28 14:38:26 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:26 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499" returned: 0 in 0.428s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:26 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499 Jul 28 14:38:26 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:26 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fd03cc04-b862-4bde-a024-7cf9ee139499" returned: 0 in 0.281s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-fd03cc04-b862-4bde-a024-7cf9ee139499" released by "delete_volume" :: held 0.754s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['487483b9-5871-49ea-8940-841d288e036d', '8b8a88f9-0dab-4833-9cbd-fd0b3dba7988', 'c66f31c7-cef1-47bf-9a06-d8014d4a1028', '059ea005-7c51-4478-99f1-1b4f0c4d0104'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:26 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:26 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:27 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.295s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-33e2ca09-fcf2-4040-b173-7ed4449a214b tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-fd03cc04-b862-4bde-a024-7cf9ee139499-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59547e2-d82f-4f38-b459-70a0f5c8605c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:27 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 Jul 28 14:38:27 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:27 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:27 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5 Jul 28 14:38:27 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:27 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5" released by "delete_volume" :: held 0.731s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['36e3ad4e-d348-4601-91f6-7542f82a3b3e', '4af623da-0c94-45cb-ab0e-f196a81a31cd', 'f409f551-f726-4819-bc09-154a929084b6', '841baa78-7837-4ce6-b412-4e721c7e79ff'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:28 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:28 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:28 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.386s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2daec8fb-3272-4d24-96bc-e358337d27b4 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-3bfd26c6-c496-4f49-9cdd-ab0b5f0b10e5-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8cac1-d853-4621-b29e-af1e5bcb1287]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:28 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 Jul 28 14:38:28 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-cf74baec-0143-465f-9aa6-940417a5a33f req-58bd4171-5f6f-419e-8bc1-0e77d0d78089 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-cf74baec-0143-465f-9aa6-940417a5a33f req-58bd4171-5f6f-419e-8bc1-0e77d0d78089 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-cf74baec-0143-465f-9aa6-940417a5a33f req-58bd4171-5f6f-419e-8bc1-0e77d0d78089 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-cf74baec-0143-465f-9aa6-940417a5a33f req-58bd4171-5f6f-419e-8bc1-0e77d0d78089 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-c70b03d6-91da-4301-94fe-2828e89bcf7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8085704a-3a6e-4704-a7aa-adadead73882', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:38:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-cf74baec-0143-465f-9aa6-940417a5a33f req-58bd4171-5f6f-419e-8bc1-0e77d0d78089 tempest-TestServerVolumeAttachmentScenario-1776491183 None] attachment_update completed successfully. Jul 28 14:38:29 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" returned: 0 in 0.500s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:29 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76 Jul 28 14:38:29 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:29 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" returned: 0 in 0.498s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76" released by "delete_volume" :: held 1.079s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['a8119ce0-1256-4094-bd92-75185bc39f17', 'ed7e8556-6ebf-409e-9f3e-0995aa1941f8', 'b913ccb1-112b-4a51-9ce8-cd368acb9b09', '56fdc5e5-910c-429d-b13b-cf253222156e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:29 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:29 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:30 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0a266a22-bff6-416b-b1cd-6e313911e0ec tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-caa7d9df-5e5f-45c0-a00d-aeb8abd4ca76-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-78f56a18-cd1d-4ce1-a480-966ff3c3fddd-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-78f56a18-cd1d-4ce1-a480-966ff3c3fddd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc5448-0aec-4d4c-907a-e32f46961b63]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:30 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd Jul 28 14:38:30 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:31 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" returned: 0 in 0.467s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:31 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd Jul 28 14:38:31 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:31 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-6760c078-6ba1-4c59-bc4c-8f0eed77cc3a req-dd753315-8de6-4a50-9ed3-e099432234b3 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Terminate volume connection completed successfully. Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-6760c078-6ba1-4c59-bc4c-8f0eed77cc3a req-dd753315-8de6-4a50-9ed3-e099432234b3 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Deleting attachment 8085704a-3a6e-4704-a7aa-adadead73882. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" returned: 0 in 0.546s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-78f56a18-cd1d-4ce1-a480-966ff3c3fddd" released by "delete_volume" :: held 1.083s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['16e88856-08c0-4d48-8bcc-2f540ddc545a', '5f584764-dc77-44d5-8ee6-e0c298443ed2', 'd8379e92-0552-4ba1-b4a9-1ce7021622c3', '2b023fc5-d463-4b66-8d58-678a8dad8c50'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:32 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:32 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:32 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.467s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-95444a8e-8f01-43fd-9998-f8c83a7d0a0f tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-78f56a18-cd1d-4ce1-a480-966ff3c3fddd-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-06fd86a3-c4e7-4803-afb5-95cbeb41194c-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-06fd86a3-c4e7-4803-afb5-95cbeb41194c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-06fd86a3-c4e7-4803-afb5-95cbeb41194c" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-06fd86a3-c4e7-4803-afb5-95cbeb41194c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleting offline snapshot 06fd86a3-c4e7-4803-afb5-95cbeb41194c of volume 424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] snapshot_file for this snap is: volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b2fe85-b7d9-4f76-a061-a675213a1f16]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:33 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c Jul 28 14:38:33 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-fe6b965c-3ea5-4600-9f68-86873078331a req-af4c3a95-8173-4b6d-b381-b6c792891aa9 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Terminate volume connection completed successfully. Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-fe6b965c-3ea5-4600-9f68-86873078331a req-af4c3a95-8173-4b6d-b381-b6c792891aa9 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Deleting attachment ea918786-66dc-4a48-9609-0a7f380777da. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:38:33 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-424121ca-8e72-4dcd-9fdc-51943a12fc25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb2d81-50cf-40f7-bcf4-4f9e4f2deb38]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:33 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 Jul 28 14:38:33 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:33 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25" returned: 0 in 0.422s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:34 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c Jul 28 14:38:34 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:34 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c" returned: 0 in 0.611s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:34 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c Jul 28 14:38:34 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25.06fd86a3-c4e7-4803-afb5-95cbeb41194c" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:34 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-06fd86a3-c4e7-4803-afb5-95cbeb41194c" released by "_delete_snapshot" :: held 1.953s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" released by "delete_snapshot" :: held 2.002s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['dcde90bb-1b3f-4c4b-bac0-f75f61102aea', '73fa2bd0-99db-4b6a-8725-e6ab0ce3e312', '66612630-34a5-4469-8890-e07c64f29763', '97a03f91-c65f-447c-88c2-c000ee232cf4'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Delete snapshot completed successfully. Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3417fa8c-bffc-4d08-98f6-a5e2d2c75700 tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-06fd86a3-c4e7-4803-afb5-95cbeb41194c-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-81901420-393d-41e0-91d5-f76d87165ced tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" by "attach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-81901420-393d-41e0-91d5-f76d87165ced tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" acquired by "attach_volume" :: waited 0.043s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-81901420-393d-41e0-91d5-f76d87165ced tempest-VolumesActionsTest-5919707 None] Attaching volume 03271d23-2d3f-4fb1-a484-9a681b35c60f to instance 7b616bef-302f-4aa6-9be3-54911ad64d22 at mountpoint /dev/vdb on host None. Jul 28 14:38:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-81901420-393d-41e0-91d5-f76d87165ced tempest-VolumesActionsTest-5919707 None] Attach volume completed successfully. Jul 28 14:38:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-81901420-393d-41e0-91d5-f76d87165ced tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f" released by "attach_volume" :: held 0.138s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bce49128-aac1-4dea-b3be-6d9ab3a016bd tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" by "detach_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bce49128-aac1-4dea-b3be-6d9ab3a016bd tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bce49128-aac1-4dea-b3be-6d9ab3a016bd tempest-VolumesActionsTest-5919707 None] Detaching volume 03271d23-2d3f-4fb1-a484-9a681b35c60f from instance 7b616bef-302f-4aa6-9be3-54911ad64d22. Jul 28 14:38:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bce49128-aac1-4dea-b3be-6d9ab3a016bd tempest-VolumesActionsTest-5919707 None] Detach volume completed successfully. Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bce49128-aac1-4dea-b3be-6d9ab3a016bd tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-424121ca-8e72-4dcd-9fdc-51943a12fc25-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-424121ca-8e72-4dcd-9fdc-51943a12fc25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e800c-82b3-4682-9a5e-d7ed712a2618]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:36 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 Jul 28 14:38:36 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:37 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25" returned: 0 in 0.568s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:37 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25 Jul 28 14:38:37 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:37 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-424121ca-8e72-4dcd-9fdc-51943a12fc25" returned: 0 in 0.446s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-quobyte-424121ca-8e72-4dcd-9fdc-51943a12fc25" released by "delete_volume" :: held 1.134s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Created reservations ['2676dc19-1e5e-4ab9-b1d7-696175b232a7', '9f3dd90c-71d7-4d8e-a54a-e77be37f1152', '9b0ad43d-f855-4ad0-bf8d-4b936ec7e1cc', 'ae20e5bd-fc71-4288-816d-6e8a25ba8b95'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:37 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:37 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:38 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:38 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Deleted volume successfully. Jul 28 14:38:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fb11920-2a32-4e64-820e-ade4bb473dcf tempest-CreateVolumesFromSnapshotTest-516146953 None] Lock "cinder-424121ca-8e72-4dcd-9fdc-51943a12fc25-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "cinder-c70b03d6-91da-4301-94fe-2828e89bcf7b-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-c70b03d6-91da-4301-94fe-2828e89bcf7b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "cinder-quobyte-c70b03d6-91da-4301-94fe-2828e89bcf7b" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-quobyte-c70b03d6-91da-4301-94fe-2828e89bcf7b" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eddc4b-6d29-4522-bb2e-2e35e49b9e60]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:40 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b Jul 28 14:38:40 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:40 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b" returned: 0 in 0.424s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:40 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b Jul 28 14:38:40 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:40 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c70b03d6-91da-4301-94fe-2828e89bcf7b" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-quobyte-c70b03d6-91da-4301-94fe-2828e89bcf7b" released by "delete_volume" :: held 0.756s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Created reservations ['7e5c1897-80a6-48f3-94fd-4485dbb1a78c', 'f00c6a08-93e1-4583-bd5f-2c2af2e3a587', '5b394706-c056-4986-8199-831ed8e023d6', '6aeec014-fa26-472e-8b1a-13d675352860'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:40 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:40 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "cinder-f093c650-3af5-4558-8102-d11be6db6a48-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-f093c650-3af5-4558-8102-d11be6db6a48-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:41 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Deleted volume successfully. Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-24554fc7-6ff3-4c0b-8dd9-6e1dbfed443b tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-c70b03d6-91da-4301-94fe-2828e89bcf7b-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "cinder-quobyte-f093c650-3af5-4558-8102-d11be6db6a48" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-quobyte-f093c650-3af5-4558-8102-d11be6db6a48" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4279913-5cf5-4605-b06d-305ccbc02e47]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:41 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 Jul 28 14:38:41 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ebb78-1ed8-4f8f-8b6e-70f26bfe69f8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:41 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:38:41 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:41 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48" returned: 0 in 0.396s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:41 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48 Jul 28 14:38:41 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:41 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465515e-7034-424c-819b-01d0b1f36de3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:41 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f093c650-3af5-4558-8102-d11be6db6a48" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:41 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:38:41 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-quobyte-f093c650-3af5-4558-8102-d11be6db6a48" released by "delete_volume" :: held 0.719s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Created reservations ['05ba1f81-f677-4799-9e10-a8c2a73f225b', '874d298f-1c2d-47f7-8d9f-26ad847f8e01', '39dedca0-e1ad-4370-b8f0-173e08060ef4', '24a83eb4-3dcd-43ff-9f3f-e6a7851a5cd3'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:41 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:41 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:42 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.414s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.fc394f3c-c601-4339-b3e3-5c35e0e6c209det2_o2d.img {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:42 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.fc394f3c-c601-4339-b3e3-5c35e0e6c209det2_o2d.img Jul 28 14:38:42 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:42 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.300s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:42 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Deleted volume successfully. Jul 28 14:38:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bc414a77-ab56-4017-9aa5-e9c547e42a09 tempest-TestServerVolumeAttachmentScenario-1776491183 None] Lock "cinder-f093c650-3af5-4558-8102-d11be6db6a48-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:38:46 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.fc394f3c-c601-4339-b3e3-5c35e0e6c209det2_o2d.img" returned: 0 in 4.783s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb0e6b-bedb-4249-a010-43d6c810096e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:47 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:38:47 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Flow 'volume_create_manager' (c45260b4-5048-4847-ad8e-1c638e487fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaff4b6-812f-494b-a5dc-86c45a03307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aaff4b6-812f-494b-a5dc-86c45a03307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12beedb-1d9e-4584-8f3d-5b51c857b821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a938438894ddaac2d5824465511da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:47Z,use_quota=True,user_id='ffd8108f9d26493ba7f3d914d8af1e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112638c3-5b4c-4917-8c38-570e1c1aaad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112638c3-5b4c-4917-8c38-570e1c1aaad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104c066f-9a5a-4d67-810f-ad584064b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:38:47 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.593s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.fc394f3c-c601-4339-b3e3-5c35e0e6c209det2_o2d.img {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:38:47 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Converted 1024.00 MB image at 214.03 MB/s Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] fc394f3c-c601-4339-b3e3-5c35e0e6c209 was raw, no need to convert to raw {{(pid=87385) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104c066f-9a5a-4d67-810f-ad584064b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c12beedb-1d9e-4584-8f3d-5b51c857b821', 'volume_name': 'volume-c12beedb-1d9e-4584-8f3d-5b51c857b821', 'volume_size': 1, 'image_id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab93aa6ac0b11add13b88d0a8ccde072', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f02a938438894ddaac2d5824465511da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ec3dc2a8dd12c25b0331e983c037e71c8181e9e65adff231034218257d039d11f6fd8c4b8df8ac60fea666f168e246472a39df78cb1d950ab5d377e84d04b7f', 'id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'created_at': datetime.datetime(2026, 7, 28, 12, 38, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56568913-62ca-4e89-a012-ff22e5dd3e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56568913-62ca-4e89-a012-ff22e5dd3e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8c017-e4f3-4837-b607-39c809ca0d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:38:47 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Volume c12beedb-1d9e-4584-8f3d-5b51c857b821: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c12beedb-1d9e-4584-8f3d-5b51c857b821', 'volume_size': 1, 'image_id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab93aa6ac0b11add13b88d0a8ccde072', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f02a938438894ddaac2d5824465511da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ec3dc2a8dd12c25b0331e983c037e71c8181e9e65adff231034218257d039d11f6fd8c4b8df8ac60fea666f168e246472a39df78cb1d950ab5d377e84d04b7f', 'id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'created_at': datetime.datetime(2026, 7, 28, 12, 38, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19/file', 'properties': {}}, 'image_service': } Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Trying to clone c12beedb-1d9e-4584-8f3d-5b51c857b821 from image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:38:47 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Image download 0.00 MB at 0.00 MB/s Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee0968-7443-4c48-bad6-922021474de5]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:47 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:38:47 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:48 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:48 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:38:48 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:48 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Temporary image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 is fetched for user ffd8108f9d26493ba7f3d914d8af1e00. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[136e6325-0893-4876-aad5-9faa3d126ff1]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:38:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:48 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:38:48 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:49 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:38:49 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:38:49 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:49 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:38:49 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:38:49 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.336s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:38:49 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:38:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:38:58 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=104,cinder:UPDATE=96,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:38:58 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=85,cinder:UPDATE=107,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.649s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Uploaded volume to glance image-id: fc394f3c-c601-4339-b3e3-5c35e0e6c209. {{(pid=87385) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.289s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12beedb-1d9e-4584-8f3d-5b51c857b821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a938438894ddaac2d5824465511da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:38:47Z,use_quota=True,user_id='ffd8108f9d26493ba7f3d914d8af1e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Creating volume c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:08 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:08 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1073741824 Jul 28 14:39:08 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-983f8acd-4838-4c3c-a90f-72cbd57b53a4 tempest-VolumesActionsTest-5919707 None] Copy volume to image completed successfully. Jul 28 14:39:09 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1073741824" returned: 0 in 0.443s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:09 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 Jul 28 14:39:09 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:09 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Attempting download of 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}])) to volume c12beedb-1d9e-4584-8f3d-5b51c857b821. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[629faffd-478d-4f1f-a6a4-6987b45d7359]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:09 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7 Jul 28 14:39:09 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:10 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7" returned: 0 in 0.393s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:10 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7 Jul 28 14:39:10 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:10 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7" returned: 1 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_589mbjw7' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eca284-9743-4cc6-a9d1-66112c435c7c]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dcddc3-785d-4490-ba85-bc2f0394f3f7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:10 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:39:10 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:10 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:39:10 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:10 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:10 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.411s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a0e84-9950-444a-9ae0-069976ff3e8b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:10 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD Jul 28 14:39:10 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:11 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:39:11 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:11 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 was raw, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:11 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 Jul 28 14:39:11 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:11 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.531s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:11 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img Jul 28 14:39:11 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:12 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821" returned: 0 in 0.735s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a9ee9c2-62ff-447d-9c62-f48e4fb46d19_epa68r_4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:39:12 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:12 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1G Jul 28 14:39:12 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:12 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 1G" returned: 0 in 0.974s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Downloaded image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}])) to volume c12beedb-1d9e-4584-8f3d-5b51c857b821 successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:39:12 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Temporary image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 for user ffd8108f9d26493ba7f3d914d8af1e00 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Marking volume c12beedb-1d9e-4584-8f3d-5b51c857b821 as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Copying metadata from image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 to c12beedb-1d9e-4584-8f3d-5b51c857b821. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Creating volume glance metadata for volume c12beedb-1d9e-4584-8f3d-5b51c857b821 backed by image 7a9ee9c2-62ff-447d-9c62-f48e4fb46d19 with: {'image_id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ab93aa6ac0b11add13b88d0a8ccde072', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8c017-e4f3-4837-b607-39c809ca0d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12beedb-1d9e-4584-8f3d-5b51c857b821', 'volume_size': 1, 'image_id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab93aa6ac0b11add13b88d0a8ccde072', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f02a938438894ddaac2d5824465511da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ec3dc2a8dd12c25b0331e983c037e71c8181e9e65adff231034218257d039d11f6fd8c4b8df8ac60fea666f168e246472a39df78cb1d950ab5d377e84d04b7f', 'id': '7a9ee9c2-62ff-447d-9c62-f48e4fb46d19', 'created_at': datetime.datetime(2026, 7, 28, 12, 38, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a9ee9c2-62ff-447d-9c62-f48e4fb46d19/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76119e9c-8a50-4bf8-b657-13a6da8d4bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Volume volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 (c12beedb-1d9e-4584-8f3d-5b51c857b821): created successfully Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76119e9c-8a50-4bf8-b657-13a6da8d4bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Flow 'volume_create_manager' (c45260b4-5048-4847-ad8e-1c638e487fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-44add28f-29c6-428a-be59-cb1addeae967 tempest-VolumeImageDependencyTests-738212235 None] Created volume successfully. Jul 28 14:39:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Acquiring lock "cinder-c12beedb-1d9e-4584-8f3d-5b51c857b821-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "cinder-c12beedb-1d9e-4584-8f3d-5b51c857b821-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Acquiring lock "cinder-quobyte-c12beedb-1d9e-4584-8f3d-5b51c857b821" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "cinder-quobyte-c12beedb-1d9e-4584-8f3d-5b51c857b821" acquired by "delete_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eeb86a-73a8-4c11-b2ef-52c81ab9574d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:15 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 Jul 28 14:39:15 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:16 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821" returned: 0 in 1.193s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:16 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821 Jul 28 14:39:16 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:16 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img" returned: 0 in 5.013s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704756b-3c22-408d-a3ff-f1fe3d69aa7f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:16 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:39:16 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:16 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c12beedb-1d9e-4584-8f3d-5b51c857b821" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "cinder-quobyte-c12beedb-1d9e-4584-8f3d-5b51c857b821" released by "delete_volume" :: held 1.599s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Created reservations ['0bfe926e-606e-48e3-82a6-f8e5642d6462', '28edb551-9f09-4912-8864-ca55a04853d5', '51c4c18a-3333-456a-913f-de1f8384f543', '7929309a-7aa0-4110-a41c-cbf5a3702b88'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:16 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:39:16 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:17 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.601s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:39:17 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Converted 1024.00 MB image at 204.21 MB/s Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] c99093bc-3225-492d-911f-e79779d74026 was raw, converting to qcow2 {{(pid=87385) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 28 14:39:17 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467beec-1bc5-40ec-9991-273fd7081aa6]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.281s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:39:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Deleted volume successfully. Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c49a086c-c541-4a2d-926b-6698a80a7e74 tempest-VolumeImageDependencyTests-738212235 None] Lock "cinder-c12beedb-1d9e-4584-8f3d-5b51c857b821-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:17 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img Jul 28 14:39:17 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:17 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:17 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img Jul 28 14:39:17 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:17 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img" returned: 1 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:39:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:17 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2 Jul 28 14:39:17 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:18 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:18 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Image conversion details: src /opt/stack/data/cinder/conversion/03271d23-2d3f-4fb1-a484-9a681b35c60f.temp_image.c99093bc-3225-492d-911f-e79779d74026wrzb55hw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:39:18 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 28 14:39:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6567a11b-01a9-4ba2-af9a-3e3fc996c2c4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:18 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2 Jul 28 14:39:18 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:18 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_orr9k3z2" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.903s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Uploaded volume to glance image-id: c99093bc-3225-492d-911f-e79779d74026. {{(pid=87385) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 14:39:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-67907e1b-7d69-4455-8208-b1b847fb2434 tempest-VolumesActionsTest-5919707 None] Copy volume to image completed successfully. Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Flow 'volume_create_manager' (eaaa439d-5e81-48bc-9428-32cc4bc5157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c3e3d5-f89d-4f67-b2dd-2153f82258cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c3e3d5-f89d-4f67-b2dd-2153f82258cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1922937784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b3a539-d0d6-4c3f-98c1-f231a993bcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ca302609c435ea7c41cd6b00f032b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:20Z,use_quota=True,user_id='36fd22ab3a1d4a44aa2fc4af63a64ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bf5b5f-7153-43bd-b218-6c515d753648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bf5b5f-7153-43bd-b218-6c515d753648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc5ff5d-db8b-41b7-a200-9a52cbb24dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc5ff5d-db8b-41b7-a200-9a52cbb24dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b3a539-d0d6-4c3f-98c1-f231a993bcee', 'volume_name': 'volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cc2d3-34e7-43f6-892b-3ec08c0e1b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881cc2d3-34e7-43f6-892b-3ec08c0e1b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0195c8bf-719e-45b4-9a6e-0cd2083b89aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Volume 81b3a539-d0d6-4c3f-98c1-f231a993bcee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee', 'volume_size': 1} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1922937784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b3a539-d0d6-4c3f-98c1-f231a993bcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ca302609c435ea7c41cd6b00f032b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:20Z,use_quota=True,user_id='36fd22ab3a1d4a44aa2fc4af63a64ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Creating volume 81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:20 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee 1073741824 Jul 28 14:39:20 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:21 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee 1073741824" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:21 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:21 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:21 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0195c8bf-719e-45b4-9a6e-0cd2083b89aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cac0c2-7f6e-4e7a-a6ae-29a077e03458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Volume volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee (81b3a539-d0d6-4c3f-98c1-f231a993bcee): created successfully Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cac0c2-7f6e-4e7a-a6ae-29a077e03458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Flow 'volume_create_manager' (eaaa439d-5e81-48bc-9428-32cc4bc5157c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e8c9172d-e726-4c8f-89b4-1d08d943255a tempest-TestImageHashVerification-997526568 None] Created volume successfully. Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Acquiring lock "cinder-quobyte-03271d23-2d3f-4fb1-a484-9a681b35c60f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "cinder-quobyte-03271d23-2d3f-4fb1-a484-9a681b35c60f" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7023be-bdee-443a-acd8-3f4d2ccb1af8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:21 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:39:21 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:22 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.385s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:22 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f Jul 28 14:39:22 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:22 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-03271d23-2d3f-4fb1-a484-9a681b35c60f" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "cinder-quobyte-03271d23-2d3f-4fb1-a484-9a681b35c60f" released by "delete_volume" :: held 0.702s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Created reservations ['79b8e78d-133e-4026-9638-ea18843c83f0', 'b64e8362-0447-470a-9970-031cc98253be', 'fa6ff0e0-7bb2-49b1-8083-7558eeb2d6dd', 'def5831b-40c5-4a0c-b405-d3d1bb737bc2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:22 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:39:22 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:23 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.297s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:39:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Deleted volume successfully. Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-14dafcb5-22d4-4fe2-ac78-8d730ba67244 tempest-VolumesActionsTest-5919707 None] Lock "cinder-03271d23-2d3f-4fb1-a484-9a681b35c60f-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716fdf2-a3b5-428e-866c-b4f8fe402edc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:24 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:24 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:24 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.379s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a29e1-b501-41d0-8553-7d138f4ea784]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:24 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:24 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:24 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.443s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee /opt/stack/data/cinder/conversion/81b3a539-d0d6-4c3f-98c1-f231a993bcee.temp_image.6391e7ef-0c10-4665-b645-39adae4d4e5bp52wf51z.img {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:24 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee /opt/stack/data/cinder/conversion/81b3a539-d0d6-4c3f-98c1-f231a993bcee.temp_image.6391e7ef-0c10-4665-b645-39adae4d4e5bp52wf51z.img Jul 28 14:39:24 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:30 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee /opt/stack/data/cinder/conversion/81b3a539-d0d6-4c3f-98c1-f231a993bcee.temp_image.6391e7ef-0c10-4665-b645-39adae4d4e5bp52wf51z.img" returned: 0 in 5.382s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7557fb3e-de55-4d9f-8946-d935285169dd]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:30 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:30 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:30 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.630s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/conversion/81b3a539-d0d6-4c3f-98c1-f231a993bcee.temp_image.6391e7ef-0c10-4665-b645-39adae4d4e5bp52wf51z.img {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:39:30 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Converted 1024.00 MB image at 190.22 MB/s Jul 28 14:39:30 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] 6391e7ef-0c10-4665-b645-39adae4d4e5b was raw, no need to convert to raw {{(pid=87385) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (a195920a-70a0-4499-90e6-ba885f72191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec167df4-7368-4e0d-9c19-ccae05c2689d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec167df4-7368-4e0d-9c19-ccae05c2689d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1736473157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c0ed-b5e4-4350-a86d-f02812689ec3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:33Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8342a4-1dd2-49e2-a499-73f397768148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8342a4-1dd2-49e2-a499-73f397768148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8a8923-61c7-4cb3-bd52-62d21a725ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8a8923-61c7-4cb3-bd52-62d21a725ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5587c0ed-b5e4-4350-a86d-f02812689ec3', 'volume_name': 'volume-5587c0ed-b5e4-4350-a86d-f02812689ec3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a325f7d8-2e89-4ec5-94e6-f5757a72f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a325f7d8-2e89-4ec5-94e6-f5757a72f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1aa163-29cf-4e1f-8d92-8fe11a169f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Volume 5587c0ed-b5e4-4350-a86d-f02812689ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5587c0ed-b5e4-4350-a86d-f02812689ec3', 'volume_size': 1} Jul 28 14:39:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:42 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=22,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:39:42 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=23,cinder:SELECT=23,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Flow 'volume_create_manager' (87b49f3f-99dc-42a4-bb57-874f278b6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3791c98-a8cf-4c5e-852d-db5a02f2b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3791c98-a8cf-4c5e-852d-db5a02f2b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750537561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfda80da-e08c-435e-833a-2a39a6b681bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94746c8a6d264baa9f9630227d3ece12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:49Z,use_quota=True,user_id='76d57533f39941e4b10efb315d54b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62414947-1576-4ab8-b2ab-0d69a042a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62414947-1576-4ab8-b2ab-0d69a042a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5199cb-a4b0-47e2-8be3-3e4438a487d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5199cb-a4b0-47e2-8be3-3e4438a487d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfda80da-e08c-435e-833a-2a39a6b681bc', 'volume_name': 'volume-dfda80da-e08c-435e-833a-2a39a6b681bc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6120fa20-e963-42d1-98a5-9312c58c867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6120fa20-e963-42d1-98a5-9312c58c867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e80c98-796c-452d-873a-29ead1dfdf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:49 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Volume dfda80da-e08c-435e-833a-2a39a6b681bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfda80da-e08c-435e-833a-2a39a6b681bc', 'volume_size': 1} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:49 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:39:49 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:49 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.253s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:39:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.439s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Uploaded volume to glance image-id: 6391e7ef-0c10-4665-b645-39adae4d4e5b. {{(pid=87385) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.439s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1736473157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c0ed-b5e4-4350-a86d-f02812689ec3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:33Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Creating volume 5587c0ed-b5e4-4350-a86d-f02812689ec3 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:52 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:52 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 1073741824 Jul 28 14:39:52 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:52 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3b7f707a-28d2-44d8-8a62-9fe7070b6695 tempest-TestImageHashVerification-997526568 None] Copy volume to image completed successfully. Jul 28 14:39:52 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 1073741824" returned: 0 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:52 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 Jul 28 14:39:52 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:53 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3" returned: 0 in 0.235s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750537561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfda80da-e08c-435e-833a-2a39a6b681bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94746c8a6d264baa9f9630227d3ece12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:49Z,use_quota=True,user_id='76d57533f39941e4b10efb315d54b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Creating volume dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1aa163-29cf-4e1f-8d92-8fe11a169f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5587c0ed-b5e4-4350-a86d-f02812689ec3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f61dce2-31bf-489b-b606-62357e16093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc 1073741824 Jul 28 14:39:53 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Volume volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 (5587c0ed-b5e4-4350-a86d-f02812689ec3): created successfully Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f61dce2-31bf-489b-b606-62357e16093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (a195920a-70a0-4499-90e6-ba885f72191f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-017bc82f-2382-4d54-8410-97df879d9d1e tempest-VolumesListTestJSON-1812298028 None] Created volume successfully. Jul 28 14:39:53 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc 1073741824" returned: 0 in 0.484s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:53 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:39:53 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (b9ef914c-0450-42b9-8b9c-df4a0c097363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b3b036-150c-49d4-8ad7-58e35dd88b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Acquiring lock "cinder-81b3a539-d0d6-4c3f-98c1-f231a993bcee-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b3b036-150c-49d4-8ad7-58e35dd88b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1183326046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179933b7-4eeb-46e9-8ea9-2b96808fc963,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:54Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c14475-de69-4932-afce-ded70a49e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c14475-de69-4932-afce-ded70a49e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cf8344-a50c-496d-9001-82d81c6931f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cf8344-a50c-496d-9001-82d81c6931f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179933b7-4eeb-46e9-8ea9-2b96808fc963', 'volume_name': 'volume-179933b7-4eeb-46e9-8ea9-2b96808fc963', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c019743-95de-4167-9088-db6cb91c18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c019743-95de-4167-9088-db6cb91c18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8b9b32-fe22-4a9f-a798-aa12d72bcef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Volume 179933b7-4eeb-46e9-8ea9-2b96808fc963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179933b7-4eeb-46e9-8ea9-2b96808fc963', 'volume_size': 1} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "cinder-81b3a539-d0d6-4c3f-98c1-f231a993bcee-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.348s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1183326046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179933b7-4eeb-46e9-8ea9-2b96808fc963,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:54Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Creating volume 179933b7-4eeb-46e9-8ea9-2b96808fc963 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e80c98-796c-452d-873a-29ead1dfdf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfda80da-e08c-435e-833a-2a39a6b681bc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:53 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 1073741824 Jul 28 14:39:53 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c381bb1-1c3c-4dd8-a77b-5b1b4c4115b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Volume volume-dfda80da-e08c-435e-833a-2a39a6b681bc (dfda80da-e08c-435e-833a-2a39a6b681bc): created successfully Jul 28 14:39:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c381bb1-1c3c-4dd8-a77b-5b1b4c4115b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Flow 'volume_create_manager' (87b49f3f-99dc-42a4-bb57-874f278b6088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Acquiring lock "cinder-quobyte-81b3a539-d0d6-4c3f-98c1-f231a993bcee" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-22bc60cb-a4f6-4098-93e5-4f3cfa3a3cb2 tempest-SnapshotDependencyTests-1699401385 None] Created volume successfully. Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "cinder-quobyte-81b3a539-d0d6-4c3f-98c1-f231a993bcee" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[534850f4-0d10-4f57-8e68-f4002d10ac2a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:54 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:54 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:54 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 1073741824" returned: 0 in 0.492s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:54 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.389s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:54 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee Jul 28 14:39:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:54 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 Jul 28 14:39:54 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:54 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81b3a539-d0d6-4c3f-98c1-f231a993bcee" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "cinder-quobyte-81b3a539-d0d6-4c3f-98c1-f231a993bcee" released by "delete_volume" :: held 0.717s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:54 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963" returned: 0 in 0.293s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.179s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8b9b32-fe22-4a9f-a798-aa12d72bcef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179933b7-4eeb-46e9-8ea9-2b96808fc963', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788a7455-046c-44d3-9d91-75e7ad2583d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Created reservations ['24fcbe64-1656-445d-b739-dc16d7d600a1', '7d4b9f4b-d80f-4049-9a50-a61734223d80', '7e5d3ebc-2190-4fcc-bdac-c1fd897b9dd4', '0141a80d-8c52-4b1a-a9d9-17abcb098013'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Creating offline snapshot afed4f75-2b97-44f3-a93c-08aee7c6411f of volume dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:39:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Volume volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 (179933b7-4eeb-46e9-8ea9-2b96808fc963): created successfully Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788a7455-046c-44d3-9d91-75e7ad2583d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (b9ef914c-0450-42b9-8b9c-df4a0c097363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcf3c17-1713-4d87-9840-de94fdb612e9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3369a8c8-db1b-47f3-949b-e65a4c5a39ac tempest-VolumesListTestJSON-1812298028 None] Created volume successfully. Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:54 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:39:54 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:54 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:39:54 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:55 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:39:55 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Deleted volume successfully. Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-763ff88e-404d-4ba2-9ffb-a9066a7b7206 tempest-TestImageHashVerification-997526568 None] Lock "cinder-81b3a539-d0d6-4c3f-98c1-f231a993bcee-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:39:55 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:55 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f 1G Jul 28 14:39:55 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:55 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f 1G" returned: 0 in 0.440s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfda80da-e08c-435e-833a-2a39a6b681bc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:55 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfda80da-e08c-435e-833a-2a39a6b681bc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:39:55 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:56 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfda80da-e08c-435e-833a-2a39a6b681bc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:56 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f is being set with open permissions: ugo+rw Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:56 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:39:56 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:56 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:56 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info Jul 28 14:39:56 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (724ab6cf-a0a6-48c7-890e-3d63feea85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea488940-e6f6-4151-8d1b-b9860d6310d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea488940-e6f6-4151-8d1b-b9860d6310d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082018055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1c4665-fa1c-479d-b60a-67d8971997c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:56Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037c6750-daa4-42f4-92a7-d1baf7e634b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037c6750-daa4-42f4-92a7-d1baf7e634b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bd6b50-7cbb-41fe-ab69-cd1730d6235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bd6b50-7cbb-41fe-ab69-cd1730d6235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1c4665-fa1c-479d-b60a-67d8971997c4', 'volume_name': 'volume-be1c4665-fa1c-479d-b60a-67d8971997c4', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af6a251-8e6e-42b0-8c20-2ff0a9131c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af6a251-8e6e-42b0-8c20-2ff0a9131c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40857357-20f5-44d7-ad0d-a7f7c8c1aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:56 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Volume be1c4665-fa1c-479d-b60a-67d8971997c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1c4665-fa1c-479d-b60a-67d8971997c4', 'volume_size': 1} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:56 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info" returned: 0 in 0.330s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:56 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info is being set with open permissions: ugo+rw Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:56 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info Jul 28 14:39:56 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:56 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.info" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2082018055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1c4665-fa1c-479d-b60a-67d8971997c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1bae0a83305a46c7b39f21bcd661adbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:56Z,use_quota=True,user_id='ba54a767210a4a39a2704e7e1f4bf235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Creating volume be1c4665-fa1c-479d-b60a-67d8971997c4 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:56 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:39:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:57 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 1073741824 Jul 28 14:39:57 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1ae82a72-ff1d-46dd-8e98-13c05876cf98 tempest-SnapshotDependencyTests-1699401385 None] Create snapshot completed successfully Jul 28 14:39:57 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 1073741824" returned: 0 in 0.537s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:57 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 Jul 28 14:39:57 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:57 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40857357-20f5-44d7-ad0d-a7f7c8c1aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1c4665-fa1c-479d-b60a-67d8971997c4', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24e3e95-2bb3-41e0-a7f2-656f29a605de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Volume volume-be1c4665-fa1c-479d-b60a-67d8971997c4 (be1c4665-fa1c-479d-b60a-67d8971997c4): created successfully Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24e3e95-2bb3-41e0-a7f2-656f29a605de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Flow 'volume_create_manager' (724ab6cf-a0a6-48c7-890e-3d63feea85aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-87fd5aaf-b832-464f-9979-8c7acc3db6bf tempest-VolumesListTestJSON-1812298028 None] Created volume successfully. Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Flow 'volume_create_manager' (0d749bea-f3c5-4e06-86d8-e3707046b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff115996-90e4-4b47-a88d-ec09fc846bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff115996-90e4-4b47-a88d-ec09fc846bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754278e6-49d9-4cb1-942c-2a5d9694929c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94746c8a6d264baa9f9630227d3ece12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=afed4f75-2b97-44f3-a93c-08aee7c6411f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:39:58Z,use_quota=True,user_id='76d57533f39941e4b10efb315d54b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0735c488-4d05-45b2-b623-b4c276232e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0735c488-4d05-45b2-b623-b4c276232e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895fd70-3887-4b92-b0b8-ff20efed5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895fd70-3887-4b92-b0b8-ff20efed5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '754278e6-49d9-4cb1-942c-2a5d9694929c', 'volume_name': 'volume-754278e6-49d9-4cb1-942c-2a5d9694929c', 'volume_size': 1, 'snapshot_id': 'afed4f75-2b97-44f3-a93c-08aee7c6411f'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2b0164-8c94-41b7-9cd2-0cd5459c7d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2b0164-8c94-41b7-9cd2-0cd5459c7d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7020fbb6-deee-4cc4-b3cb-518302e61661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:39:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Volume 754278e6-49d9-4cb1-942c-2a5d9694929c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-754278e6-49d9-4cb1-942c-2a5d9694929c', 'volume_size': 1, 'snapshot_id': 'afed4f75-2b97-44f3-a93c-08aee7c6411f'} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f-754278e6-49d9-4cb1-942c-2a5d9694929c" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f-754278e6-49d9-4cb1-942c-2a5d9694929c" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Creating volume 754278e6-49d9-4cb1-942c-2a5d9694929c from snapshot afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] snapshot: afed4f75-2b97-44f3-a93c-08aee7c6411f, volume: 754278e6-49d9-4cb1-942c-2a5d9694929c, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e564376-29d6-4e71-8943-9aad3ca5181d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:58 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:39:58 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:59 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.420s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfda80da-e08c-435e-833a-2a39a6b681bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1a4e3-350a-464f-bfd4-8378bd971ce4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:59 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:39:59 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:39:59 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.449s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:39:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:39:59 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c Jul 28 14:39:59 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-be1c4665-fa1c-479d-b60a-67d8971997c4-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-be1c4665-fa1c-479d-b60a-67d8971997c4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-quobyte-be1c4665-fa1c-479d-b60a-67d8971997c4" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-be1c4665-fa1c-479d-b60a-67d8971997c4" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f70519-3c19-4dd5-b6a0-9be91cb5f801]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:02 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 Jul 28 14:40:02 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:03 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4" returned: 0 in 1.373s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:03 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4 Jul 28 14:40:03 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:03 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-be1c4665-fa1c-479d-b60a-67d8971997c4" returned: 0 in 0.715s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-be1c4665-fa1c-479d-b60a-67d8971997c4" released by "delete_volume" :: held 2.183s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Created reservations ['55bbcdbd-a740-493f-b647-df56dd2ab69f', '7b689c36-9a36-4d53-9a77-e0a19d2d3304', '8aabe476-9601-4890-811a-401762fee87f', '470e25a8-cd65-4e86-968b-1a0f32a35355'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:04 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:04 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:04 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.541s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Deleted volume successfully. Jul 28 14:40:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c41b1d38-86cc-4bbf-9417-237d4c4f6ff8 tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-be1c4665-fa1c-479d-b60a-67d8971997c4-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:05 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c" returned: 0 in 5.612s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[add1570d-93b5-4c1d-bff3-d6f2c505dcec]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:05 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:40:05 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-179933b7-4eeb-46e9-8ea9-2b96808fc963-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-179933b7-4eeb-46e9-8ea9-2b96808fc963-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-quobyte-179933b7-4eeb-46e9-8ea9-2b96808fc963" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-179933b7-4eeb-46e9-8ea9-2b96808fc963" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae9e1f-c1df-48d0-b231-a8b1287f477c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:05 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 Jul 28 14:40:05 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:05 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.660s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:40:05 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Converted 1024.00 MB image at 182.45 MB/s Jul 28 14:40:05 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c is being set with open permissions: ugo+rw Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:05 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c Jul 28 14:40:05 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:05 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963" returned: 0 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:05 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963 Jul 28 14:40:05 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:06 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c" returned: 0 in 0.333s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:06 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-179933b7-4eeb-46e9-8ea9-2b96808fc963" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" released by "_copy_volume_from_snapshot" :: held 7.600s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f-754278e6-49d9-4cb1-942c-2a5d9694929c" released by "_create_volume_from_snapshot" :: held 7.664s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.687s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-179933b7-4eeb-46e9-8ea9-2b96808fc963" released by "delete_volume" :: held 0.802s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7020fbb6-deee-4cc4-b3cb-518302e61661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754278e6-49d9-4cb1-942c-2a5d9694929c', 'volume_size': 1, 'snapshot_id': 'afed4f75-2b97-44f3-a93c-08aee7c6411f'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d17aaa6-ab05-4f85-ad87-70958a6d719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Volume volume-754278e6-49d9-4cb1-942c-2a5d9694929c (754278e6-49d9-4cb1-942c-2a5d9694929c): created successfully Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d17aaa6-ab05-4f85-ad87-70958a6d719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Flow 'volume_create_manager' (0d749bea-f3c5-4e06-86d8-e3707046b757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Created reservations ['6528c601-5979-4a36-ae7b-1290088a03f0', '210408b1-1d76-40b0-bc42-916be353e335', '06d07a0f-4492-4a70-8a39-d9f9a54a760d', '8be1f5cb-9a97-4e25-911d-6068e47797e0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-afc8a8ac-53aa-44a6-996d-22019f6db839 tempest-SnapshotDependencyTests-1699401385 None] Created volume successfully. Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:06 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:06 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-5587c0ed-b5e4-4350-a86d-f02812689ec3-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-5587c0ed-b5e4-4350-a86d-f02812689ec3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:06 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Deleted volume successfully. Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "cinder-quobyte-5587c0ed-b5e4-4350-a86d-f02812689ec3" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-5587c0ed-b5e4-4350-a86d-f02812689ec3" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8fa478fc-2b3a-4956-bfb0-9abbddcc35de tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-179933b7-4eeb-46e9-8ea9-2b96808fc963-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da0a10-b474-4021-8a10-3550ceb3ec1c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:06 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 Jul 28 14:40:06 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:07 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:07 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3 Jul 28 14:40:07 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:07 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-5587c0ed-b5e4-4350-a86d-f02812689ec3" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-quobyte-5587c0ed-b5e4-4350-a86d-f02812689ec3" released by "delete_volume" :: held 0.696s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-afed4f75-2b97-44f3-a93c-08aee7c6411f-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-afed4f75-2b97-44f3-a93c-08aee7c6411f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Created reservations ['997eea79-36fd-4199-a5f7-20bb33867aab', '589d11d4-7e81-43ae-a9b1-29223486c3d2', '5dbe53d5-3afc-4990-9c81-931e731a00f1', 'c7f43f0d-548d-447f-8513-9506f22a2a03'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Deleting offline snapshot afed4f75-2b97-44f3-a93c-08aee7c6411f of volume dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] snapshot_file for this snap is: volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb9686-adab-4daf-a9f4-343b23a2349c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:07 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:07 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:07 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:40:07 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:07 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Deleted volume successfully. Jul 28 14:40:07 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ff2517b2-9a83-4ed1-9097-6bc6b482cdea tempest-VolumesListTestJSON-1812298028 None] Lock "cinder-5587c0ed-b5e4-4350-a86d-f02812689ec3-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.412s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfda80da-e08c-435e-833a-2a39a6b681bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc87932-1779-477e-9556-2c580b7be0eb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:08 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:40:08 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:08 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.414s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:08 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:40:08 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:08 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:08 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f Jul 28 14:40:08 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:09 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc.afed4f75-2b97-44f3-a93c-08aee7c6411f" returned: 0 in 0.295s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-afed4f75-2b97-44f3-a93c-08aee7c6411f" released by "_delete_snapshot" :: held 1.679s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" released by "delete_snapshot" :: held 1.712s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Created reservations ['db7de1ce-93bf-4b26-b9ef-7c9a868f1302', '6479c84a-89bf-4d99-9977-78ace0b33761', '14e9bb72-d23d-4ade-ad86-af6a636f6677', 'f22a797d-09d1-444c-8f6e-fa660e2f636a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Delete snapshot completed successfully. Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-356806a4-75b7-4cce-a877-e7fafb50cc9d tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-afed4f75-2b97-44f3-a93c-08aee7c6411f-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-dfda80da-e08c-435e-833a-2a39a6b681bc-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-dfda80da-e08c-435e-833a-2a39a6b681bc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d3d198-d80d-466d-a96e-9a5e762e9bee]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:09 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:40:09 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:10 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.396s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:10 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc Jul 28 14:40:10 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:10 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-dfda80da-e08c-435e-833a-2a39a6b681bc" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-dfda80da-e08c-435e-833a-2a39a6b681bc" released by "delete_volume" :: held 0.728s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Created reservations ['d70b0daa-7544-47e3-9dcd-1d7b42e81944', '8d66d5ca-07ea-4fab-903d-4244901eb237', 'b7ccb85d-35e3-4167-8293-e9f7ddf49e65', '2ed87f6f-b388-49d3-bd4a-b6a03a80937c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:10 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:10 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-754278e6-49d9-4cb1-942c-2a5d9694929c-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-754278e6-49d9-4cb1-942c-2a5d9694929c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:11 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Deleted volume successfully. Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579a53f-621b-43b6-9bc2-ad6773c43b7b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e07a01d6-98c9-4a2b-8079-e005a625fa81 tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-dfda80da-e08c-435e-833a-2a39a6b681bc-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:11 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c Jul 28 14:40:11 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:11 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c" returned: 0 in 0.443s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:11 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c Jul 28 14:40:11 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:11 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-754278e6-49d9-4cb1-942c-2a5d9694929c" returned: 0 in 0.338s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-quobyte-754278e6-49d9-4cb1-942c-2a5d9694929c" released by "delete_volume" :: held 0.839s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Created reservations ['43699ad6-80ac-4052-80d8-f000e1792ce2', 'dcd0d5c0-971f-4af1-8459-c3a062c1c5ea', '72a93e27-bf1a-424a-bba6-eef7795a8d84', '410a4aa8-500f-4619-a08d-bee8619089d5'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:12 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:12 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:12 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Deleted volume successfully. Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11e02953-760a-47b6-8e1f-e93c0d4a4a1c tempest-SnapshotDependencyTests-1699401385 None] Lock "cinder-754278e6-49d9-4cb1-942c-2a5d9694929c-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Flow 'volume_create_manager' (9adc28ff-fe9a-4f96-bb89-aef3ca27af4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f535fe-1d3a-43e3-a5a3-a042c9117095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f535fe-1d3a-43e3-a5a3-a042c9117095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca50a1b-9477-4951-a857-87d4a60cd2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc760ede8374aa6b9c5cd62df00e858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:13Z,use_quota=True,user_id='fb5f9c399c4547188926c98c70535435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a405a68c-8cb5-4ccf-8afc-f787013589fe),volume_type_id=a405a68c-8cb5-4ccf-8afc-f787013589fe)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04669289-ecfc-41c3-b00f-1a0f30e6a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04669289-ecfc-41c3-b00f-1a0f30e6a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93273e1f-a7c1-4d4c-b3ce-73460480b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:12 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93273e1f-a7c1-4d4c-b3ce-73460480b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aca50a1b-9477-4951-a857-87d4a60cd2cb', 'volume_name': 'volume-aca50a1b-9477-4951-a857-87d4a60cd2cb', 'volume_size': 1, 'image_id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31ea10bd5395d7ba2b6cc18174fbe9e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccc760ede8374aa6b9c5cd62df00e858', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c86e12a5573205e9897ec63591c8d55beac92f8b8d30e8159bc9d7bbc7e77ddcb616b72b3ad660bfc01da25d3a5c44311d9e1c55120f07a5a891bf5d45166793', 'id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aac05f7-3cba-47e6-9ad4-3b30abb7804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aac05f7-3cba-47e6-9ad4-3b30abb7804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe0cc03-d08d-4be0-aaa3-96c6348d9197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Volume aca50a1b-9477-4951-a857-87d4a60cd2cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aca50a1b-9477-4951-a857-87d4a60cd2cb', 'volume_size': 1, 'image_id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31ea10bd5395d7ba2b6cc18174fbe9e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccc760ede8374aa6b9c5cd62df00e858', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c86e12a5573205e9897ec63591c8d55beac92f8b8d30e8159bc9d7bbc7e77ddcb616b72b3ad660bfc01da25d3a5c44311d9e1c55120f07a5a891bf5d45166793', 'id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Trying to clone aca50a1b-9477-4951-a857-87d4a60cd2cb from image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:40:13 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Image download 0.00 MB at 0.00 MB/s Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[904672cb-8a61-4635-8106-dfc2e9178786]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:13 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:13 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:13 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:13 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:13 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:14 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Temporary image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af is fetched for user fb5f9c399c4547188926c98c70535435. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff54a99e-e0eb-431d-840a-531e378be0bf]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:14 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:14 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:14 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:14 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:14 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:14 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca50a1b-9477-4951-a857-87d4a60cd2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc760ede8374aa6b9c5cd62df00e858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:13Z,use_quota=True,user_id='fb5f9c399c4547188926c98c70535435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a405a68c-8cb5-4ccf-8afc-f787013589fe),volume_type_id=a405a68c-8cb5-4ccf-8afc-f787013589fe)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Creating volume aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:14 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:14 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1073741824 Jul 28 14:40:14 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:15 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1073741824" returned: 0 in 0.568s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:15 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb Jul 28 14:40:15 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:15 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Attempting download of c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af ((None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}])) to volume aca50a1b-9477-4951-a857-87d4a60cd2cb. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d8458-c0fe-46ca-8e66-c6e7abcc746a]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:16 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5 Jul 28 14:40:16 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:16 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:16 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5 Jul 28 14:40:16 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:16 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5" returned: 1 in 0.407s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_6ykuwzf5' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9272dd-4c5d-46a2-a4f2-98ac2e25f73a]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:16 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:16 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:17 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:17 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD Jul 28 14:40:17 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:17 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af was raw, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:40:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:17 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb Jul 28 14:40:17 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:18 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb" returned: 0 in 0.545s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af_hq20dz2bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:40:18 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:18 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1G Jul 28 14:40:18 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:18 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb 1G" returned: 0 in 0.368s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Downloaded image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af ((None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}])) to volume aca50a1b-9477-4951-a857-87d4a60cd2cb successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Temporary image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af for user fb5f9c399c4547188926c98c70535435 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Marking volume aca50a1b-9477-4951-a857-87d4a60cd2cb as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Copying metadata from image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af to aca50a1b-9477-4951-a857-87d4a60cd2cb. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Creating volume glance metadata for volume aca50a1b-9477-4951-a857-87d4a60cd2cb backed by image c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '31ea10bd5395d7ba2b6cc18174fbe9e0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe0cc03-d08d-4be0-aaa3-96c6348d9197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca50a1b-9477-4951-a857-87d4a60cd2cb', 'volume_size': 1, 'image_id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31ea10bd5395d7ba2b6cc18174fbe9e0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ccc760ede8374aa6b9c5cd62df00e858', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c86e12a5573205e9897ec63591c8d55beac92f8b8d30e8159bc9d7bbc7e77ddcb616b72b3ad660bfc01da25d3a5c44311d9e1c55120f07a5a891bf5d45166793', 'id': 'c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9afbbc2-eeba-4f0b-8d74-0f8cc9e899af/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b9d9de-d801-4ab2-8155-5f6d3c07bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:18 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Volume volume-aca50a1b-9477-4951-a857-87d4a60cd2cb (aca50a1b-9477-4951-a857-87d4a60cd2cb): created successfully Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b9d9de-d801-4ab2-8155-5f6d3c07bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:18 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Flow 'volume_create_manager' (9adc28ff-fe9a-4f96-bb89-aef3ca27af4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:18 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a451f92d-7248-47e0-9ee0-d63c35aefba1 tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Created volume successfully. Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Acquiring lock "cinder-aca50a1b-9477-4951-a857-87d4a60cd2cb-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "cinder-aca50a1b-9477-4951-a857-87d4a60cd2cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Acquiring lock "cinder-quobyte-aca50a1b-9477-4951-a857-87d4a60cd2cb" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "cinder-quobyte-aca50a1b-9477-4951-a857-87d4a60cd2cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d164e258-d19d-44d1-9814-ece8d789dc5c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:19 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb Jul 28 14:40:19 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:19 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:19 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb Jul 28 14:40:19 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:19 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-aca50a1b-9477-4951-a857-87d4a60cd2cb" returned: 0 in 0.354s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "cinder-quobyte-aca50a1b-9477-4951-a857-87d4a60cd2cb" released by "delete_volume" :: held 0.822s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:20 devstack cinder-volume[87385]: WARNING cinder.quota [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:40:20 devstack cinder-volume[87385]: WARNING cinder.quota [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Created reservations ['0ebf50cf-d0b4-48bc-9729-826fc873fe08', '6b6ea5bb-f6ae-4f1e-96ab-153bf208ae89', '76dd880e-9c33-4123-923a-72daddc4a426', '7c9114e4-197c-4d37-9046-a73a8a0e2e92'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:20 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:20 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:20 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Deleted volume successfully. Jul 28 14:40:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f94103cb-e42b-459a-873d-271d90bdfc3f tempest-VolumeAndVolumeTypeFromImageTest-14715640 None] Lock "cinder-aca50a1b-9477-4951-a857-87d4a60cd2cb-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (4ef49489-0105-4300-ad98-b8931b8dcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c93a7a-ebcc-4940-9fe5-b95d856efdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c93a7a-ebcc-4940-9fe5-b95d856efdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990475889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b09c98-f3a7-45dd-93d8-09f22bec0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:26Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeed8d5a-53c5-4f4a-b7ec-d4d2a2354fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeed8d5a-53c5-4f4a-b7ec-d4d2a2354fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4feaf5-68c8-43d2-bd0c-c4c3aee918e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4feaf5-68c8-43d2-bd0c-c4c3aee918e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b09c98-f3a7-45dd-93d8-09f22bec0ed0', 'volume_name': 'volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e795c1d2-d4d2-49f3-a17b-9f34210df957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e795c1d2-d4d2-49f3-a17b-9f34210df957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aafc47-1797-41e8-9929-f5e81e9dbffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:26 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume 15b09c98-f3a7-45dd-93d8-09f22bec0ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0', 'volume_size': 1} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990475889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b09c98-f3a7-45dd-93d8-09f22bec0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:26Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume 15b09c98-f3a7-45dd-93d8-09f22bec0ed0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:26 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:26 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 1073741824 Jul 28 14:40:26 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:26 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 1073741824" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:26 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 Jul 28 14:40:26 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:27 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63aafc47-1797-41e8-9929-f5e81e9dbffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3cac37-e0e2-4614-ab83-e580d647d757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 (15b09c98-f3a7-45dd-93d8-09f22bec0ed0): created successfully Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3cac37-e0e2-4614-ab83-e580d647d757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (4ef49489-0105-4300-ad98-b8931b8dcd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c7c36749-e283-439e-aeb3-2d4af06a9bd8 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (f8f7c776-0424-42c6-baf2-11b4e7262bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1776192-4829-4ed9-a966-e938e8ee2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1776192-4829-4ed9-a966-e938e8ee2be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738505798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b560e4a-e744-4b45-b0c7-40b769da1a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:28Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd337a2a-84c0-4312-a6a8-73650d2a523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd337a2a-84c0-4312-a6a8-73650d2a523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075d5d11-359f-40f5-8660-12e313c96958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075d5d11-359f-40f5-8660-12e313c96958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b560e4a-e744-4b45-b0c7-40b769da1a14', 'volume_name': 'volume-6b560e4a-e744-4b45-b0c7-40b769da1a14', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07fd719-cb89-4f91-8ac3-c69913f94c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07fd719-cb89-4f91-8ac3-c69913f94c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5f9aa-4458-44bd-a3ef-c322ddb68e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume 6b560e4a-e744-4b45-b0c7-40b769da1a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b560e4a-e744-4b45-b0c7-40b769da1a14', 'volume_size': 1} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738505798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b560e4a-e744-4b45-b0c7-40b769da1a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:28Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume 6b560e4a-e744-4b45-b0c7-40b769da1a14 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:27 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:27 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 1073741824 Jul 28 14:40:27 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (7aeaaf57-e52e-4d95-ac12-702196c726ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ce53b7-dcc4-43e7-aa0a-9b7543d8843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ce53b7-dcc4-43e7-aa0a-9b7543d8843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397253336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952fe087-0c4b-4b01-9ad2-fd3275eb31e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:28Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bbcb67-1073-4450-bf70-7e583cc2e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bbcb67-1073-4450-bf70-7e583cc2e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a062c7b2-d2b6-48ae-bb4a-b7d3109a5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a062c7b2-d2b6-48ae-bb4a-b7d3109a5a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952fe087-0c4b-4b01-9ad2-fd3275eb31e5', 'volume_name': 'volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d9b76f-3a46-40ca-8883-4e3edcfcf085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d9b76f-3a46-40ca-8883-4e3edcfcf085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfb66c3-c616-42a8-b4fd-969bb6f4f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume 952fe087-0c4b-4b01-9ad2-fd3275eb31e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5', 'volume_size': 1} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:28 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 1073741824" returned: 0 in 0.682s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:28 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 Jul 28 14:40:28 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (146bffd5-bcd6-4307-8988-d0aaac3602c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748b30d-64f8-4b08-878d-253800d0e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748b30d-64f8-4b08-878d-253800d0e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1360137433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be39c8a-7102-4be9-9298-e436b199269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:29Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1208e-502f-413c-b330-d32e69759495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe1208e-502f-413c-b330-d32e69759495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b64b01-0a36-4688-b237-311b0e0df2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b64b01-0a36-4688-b237-311b0e0df2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be39c8a-7102-4be9-9298-e436b199269e', 'volume_name': 'volume-6be39c8a-7102-4be9-9298-e436b199269e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2294dd-91dc-4f04-a191-2579ef49f7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2294dd-91dc-4f04-a191-2579ef49f7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54e529d-3691-4fb3-a60b-2b4e360fe799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume 6be39c8a-7102-4be9-9298-e436b199269e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be39c8a-7102-4be9-9298-e436b199269e', 'volume_size': 1} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:28 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397253336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952fe087-0c4b-4b01-9ad2-fd3275eb31e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:28Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume 952fe087-0c4b-4b01-9ad2-fd3275eb31e5 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:28 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5f9aa-4458-44bd-a3ef-c322ddb68e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b560e4a-e744-4b45-b0c7-40b769da1a14', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22447b43-da6c-4d94-8050-47c3b0ffb280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:28 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 1073741824 Jul 28 14:40:28 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:28 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 (6b560e4a-e744-4b45-b0c7-40b769da1a14): created successfully Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22447b43-da6c-4d94-8050-47c3b0ffb280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:28 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (f8f7c776-0424-42c6-baf2-11b4e7262bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-862daf0d-cc1e-4cfd-bb36-4407addb3472 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (2f231276-83f6-4353-9369-c8170274dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea8f5b-6924-4727-9483-82497aead39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ea8f5b-6924-4727-9483-82497aead39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213220445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f638377-1d36-46d6-a544-5539d3f6787f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:29Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7b6d87-7559-455d-894c-ce8507c6e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7b6d87-7559-455d-894c-ce8507c6e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d45101-ffc8-48d7-a8bd-5fc280b709c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d45101-ffc8-48d7-a8bd-5fc280b709c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f638377-1d36-46d6-a544-5539d3f6787f', 'volume_name': 'volume-8f638377-1d36-46d6-a544-5539d3f6787f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491e817-f3e2-4d77-b406-f1835edc09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491e817-f3e2-4d77-b406-f1835edc09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71147250-1a01-458d-bd8f-638913dc8b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume 8f638377-1d36-46d6-a544-5539d3f6787f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f638377-1d36-46d6-a544-5539d3f6787f', 'volume_size': 1} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:29 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 1073741824" returned: 0 in 0.660s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:29 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 Jul 28 14:40:29 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (c273e79e-e4d5-419b-ada2-5af4c6423652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e4b8ff-a8e7-4de8-93f0-9dbe1858dce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e4b8ff-a8e7-4de8-93f0-9dbe1858dce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-869921304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a61e29-f034-443f-b99a-559b9f3b05ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:30Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e317ab8e-45a7-4754-99f8-6a3ec83bc0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e317ab8e-45a7-4754-99f8-6a3ec83bc0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd55215-0db4-4bf9-8912-7ab4a0e91e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd55215-0db4-4bf9-8912-7ab4a0e91e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a61e29-f034-443f-b99a-559b9f3b05ef', 'volume_name': 'volume-a6a61e29-f034-443f-b99a-559b9f3b05ef', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c460e93b-0435-4f19-a5dd-050e11aa01a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c460e93b-0435-4f19-a5dd-050e11aa01a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e6dbdc-e296-4841-aef7-8d2fad68f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume a6a61e29-f034-443f-b99a-559b9f3b05ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a61e29-f034-443f-b99a-559b9f3b05ef', 'volume_size': 1} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:29 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1360137433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be39c8a-7102-4be9-9298-e436b199269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:29Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume 6be39c8a-7102-4be9-9298-e436b199269e {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:29 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfb66c3-c616-42a8-b4fd-969bb6f4f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e 1073741824 Jul 28 14:40:29 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d9eb80-0bf0-4457-ba56-b41f4274f19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 (952fe087-0c4b-4b01-9ad2-fd3275eb31e5): created successfully Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d9eb80-0bf0-4457-ba56-b41f4274f19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (7aeaaf57-e52e-4d95-ac12-702196c726ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d9a0cb12-7ac9-48a3-90e4-c6e529c6ab15 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:30 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e 1073741824" returned: 0 in 0.546s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:30 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e Jul 28 14:40:30 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:30 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e" returned: 0 in 0.311s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213220445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f638377-1d36-46d6-a544-5539d3f6787f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:29Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume 8f638377-1d36-46d6-a544-5539d3f6787f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:30 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54e529d-3691-4fb3-a60b-2b4e360fe799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be39c8a-7102-4be9-9298-e436b199269e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d108a725-bdbd-4158-9248-a0d13c6e181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:30 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f 1073741824 Jul 28 14:40:30 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:30 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-6be39c8a-7102-4be9-9298-e436b199269e (6be39c8a-7102-4be9-9298-e436b199269e): created successfully Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d108a725-bdbd-4158-9248-a0d13c6e181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:30 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (146bffd5-bcd6-4307-8988-d0aaac3602c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-612f4ce6-43f6-40f1-8579-a859ceb984a0 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:31 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f 1073741824" returned: 0 in 0.506s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:31 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f Jul 28 14:40:31 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:31 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.872s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-869921304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a61e29-f034-443f-b99a-559b9f3b05ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e472f6ab0798429cbc2deceaea97b5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:30Z,use_quota=True,user_id='28ad77fc05b142809ba8c4abad8b5262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Creating volume a6a61e29-f034-443f-b99a-559b9f3b05ef {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:31 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:31 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef 1073741824 Jul 28 14:40:31 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71147250-1a01-458d-bd8f-638913dc8b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f638377-1d36-46d6-a544-5539d3f6787f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8473489-3728-4545-8dd4-b34801074ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-8f638377-1d36-46d6-a544-5539d3f6787f (8f638377-1d36-46d6-a544-5539d3f6787f): created successfully Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8473489-3728-4545-8dd4-b34801074ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (2f231276-83f6-4353-9369-c8170274dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8d8428d6-3aa3-40c0-9759-1cd024f3af23 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:32 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef 1073741824" returned: 0 in 0.476s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:32 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef Jul 28 14:40:32 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:32 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e6dbdc-e296-4841-aef7-8d2fad68f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a61e29-f034-443f-b99a-559b9f3b05ef', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54a1b96-e8f8-45a6-9810-7937ec6952cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Volume volume-a6a61e29-f034-443f-b99a-559b9f3b05ef (a6a61e29-f034-443f-b99a-559b9f3b05ef): created successfully Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54a1b96-e8f8-45a6-9810-7937ec6952cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Flow 'volume_create_manager' (c273e79e-e4d5-419b-ada2-5af4c6423652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3f873604-083f-438c-a8a6-a13bf92c243d tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created volume successfully. Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-a6a61e29-f034-443f-b99a-559b9f3b05ef-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-a6a61e29-f034-443f-b99a-559b9f3b05ef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-a6a61e29-f034-443f-b99a-559b9f3b05ef" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-a6a61e29-f034-443f-b99a-559b9f3b05ef" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3171097-3aa1-4a48-a211-0006be303e52]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:33 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef Jul 28 14:40:33 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:33 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:33 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef Jul 28 14:40:33 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:33 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6a61e29-f034-443f-b99a-559b9f3b05ef" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-a6a61e29-f034-443f-b99a-559b9f3b05ef" released by "delete_volume" :: held 0.722s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:33 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['6631c0e6-1aa9-433e-871d-f67283531fa9', '9f530cdb-b78f-4c32-a488-0bb0f47bb708', '9eb0e777-07be-4d4e-a95e-fc8cbecf8476', 'ce88d204-973c-4516-90ca-26a634f63c16'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:34 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:34 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-8f638377-1d36-46d6-a544-5539d3f6787f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-8f638377-1d36-46d6-a544-5539d3f6787f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:34 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.289s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-8f638377-1d36-46d6-a544-5539d3f6787f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-8f638377-1d36-46d6-a544-5539d3f6787f" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8d31e000-1abc-416c-a4e3-b1f6ad9d0ef1 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-a6a61e29-f034-443f-b99a-559b9f3b05ef-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c639ab-bde3-47e9-a108-ab432d30753d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:34 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f Jul 28 14:40:34 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:34 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:34 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f Jul 28 14:40:34 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:35 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8f638377-1d36-46d6-a544-5539d3f6787f" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-8f638377-1d36-46d6-a544-5539d3f6787f" released by "delete_volume" :: held 0.684s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['7f2cd959-aff2-40df-9df3-792697b4ca41', '1aa7625a-e3e8-4120-8a94-099a4958b9c9', 'a465605d-cb71-41fd-b9c6-1a5c24ca6f32', 'caf01420-8087-42ce-849e-c328c1861cdc'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:35 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:35 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:35 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-6be39c8a-7102-4be9-9298-e436b199269e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-716d08e7-3e92-4344-b5cd-5813ea6e7878 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-8f638377-1d36-46d6-a544-5539d3f6787f-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-6be39c8a-7102-4be9-9298-e436b199269e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-6be39c8a-7102-4be9-9298-e436b199269e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-6be39c8a-7102-4be9-9298-e436b199269e" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[253a220f-a06c-41ad-915f-9879c2dcf21d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:35 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e Jul 28 14:40:35 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:35 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:36 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e Jul 28 14:40:36 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:36 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6be39c8a-7102-4be9-9298-e436b199269e" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-6be39c8a-7102-4be9-9298-e436b199269e" released by "delete_volume" :: held 0.660s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['117d7390-eb95-4a59-b8b8-f1a45e5c7d5b', '0d32bba1-79b8-4a67-bc46-7d518d11674d', '8b14ff24-1407-4d0a-9d4c-2daf37fd137e', '051a6c1c-f349-4587-ae89-84269dc71c38'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:36 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:36 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:36 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:36 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4bdf1dd0-6b49-47db-b6d8-ab02f09822c2 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-6be39c8a-7102-4be9-9298-e436b199269e-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-952fe087-0c4b-4b01-9ad2-fd3275eb31e5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-952fe087-0c4b-4b01-9ad2-fd3275eb31e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f01d85-db10-415b-aa03-896e377d56ae]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:36 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 Jul 28 14:40:36 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (939696c0-1093-4a26-a7aa-5c8d1edfa3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381353b0-36a0-4985-9f18-207cbd13d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381353b0-36a0-4985-9f18-207cbd13d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2042718072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86db8599-3bc0-44ff-a97c-3e50694fc689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:37Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93c65b55-3933-4ba9-8c21-2242ee0d16ed),volume_type_id=93c65b55-3933-4ba9-8c21-2242ee0d16ed)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df77431-a312-4b5c-81ec-0482ab5c3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df77431-a312-4b5c-81ec-0482ab5c3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311783a-f732-4cb2-91c5-534f087f88a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311783a-f732-4cb2-91c5-534f087f88a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86db8599-3bc0-44ff-a97c-3e50694fc689', 'volume_name': 'volume-86db8599-3bc0-44ff-a97c-3e50694fc689', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798a369-9013-4740-9ee8-4b0305c1df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798a369-9013-4740-9ee8-4b0305c1df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993ec924-1a6d-4c09-9ad8-6b5ab70ca0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume 86db8599-3bc0-44ff-a97c-3e50694fc689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86db8599-3bc0-44ff-a97c-3e50694fc689', 'volume_size': 1} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2042718072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86db8599-3bc0-44ff-a97c-3e50694fc689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:37Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93c65b55-3933-4ba9-8c21-2242ee0d16ed),volume_type_id=93c65b55-3933-4ba9-8c21-2242ee0d16ed)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Creating volume 86db8599-3bc0-44ff-a97c-3e50694fc689 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:37 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:37 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 1073741824 Jul 28 14:40:37 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:37 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" returned: 0 in 0.381s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:37 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5 Jul 28 14:40:37 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (582c9ac7-6b21-4aa6-b362-4041b3b1a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a2059c-d741-41b3-b6b8-c682fd063adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a2059c-d741-41b3-b6b8-c682fd063adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1540526607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0600d688-5807-49c1-9a19-14618fb977a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:37Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aaeffb3-14b0-4b07-b3aa-921c515d2060),volume_type_id=6aaeffb3-14b0-4b07-b3aa-921c515d2060)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babad5f2-bdc1-4c5b-9690-c23508c468d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babad5f2-bdc1-4c5b-9690-c23508c468d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686600b4-3e7e-4fdb-af54-b90026236225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686600b4-3e7e-4fdb-af54-b90026236225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0600d688-5807-49c1-9a19-14618fb977a0', 'volume_name': 'volume-0600d688-5807-49c1-9a19-14618fb977a0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f622569-df1d-46a7-8da5-7f6ceaede4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f622569-df1d-46a7-8da5-7f6ceaede4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87ef73-5b19-48f7-8a2d-dcfd2a5b4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:37 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume 0600d688-5807-49c1-9a19-14618fb977a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0600d688-5807-49c1-9a19-14618fb977a0', 'volume_size': 1} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:37 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" returned: 0 in 0.363s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-952fe087-0c4b-4b01-9ad2-fd3275eb31e5" released by "delete_volume" :: held 0.790s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['c0c3b79d-59fb-474a-a75c-b7ed791d6690', 'b650af16-959a-4ca0-be2c-c2ca0da9ad4d', 'b943b00f-3199-45f7-86b4-4a9229c1e6b8', '164a9284-2b21-4775-a1b8-f28e22130473'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:37 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 1073741824" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:37 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 Jul 28 14:40:37 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:37 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:37 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-6b560e4a-e744-4b45-b0c7-40b769da1a14-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-6b560e4a-e744-4b45-b0c7-40b769da1a14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-6b560e4a-e744-4b45-b0c7-40b769da1a14" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:38 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-6b560e4a-e744-4b45-b0c7-40b769da1a14" acquired by "delete_volume" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.300s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd97ef-3745-49ae-9783-c1fc3710d43b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:38 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689" returned: 0 in 0.394s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a097712a-affa-4b9c-8991-154d83337941 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-952fe087-0c4b-4b01-9ad2-fd3275eb31e5-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1540526607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0600d688-5807-49c1-9a19-14618fb977a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:37Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6aaeffb3-14b0-4b07-b3aa-921c515d2060),volume_type_id=6aaeffb3-14b0-4b07-b3aa-921c515d2060)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Creating volume 0600d688-5807-49c1-9a19-14618fb977a0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:38 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 1073741824 Jul 28 14:40:38 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993ec924-1a6d-4c09-9ad8-6b5ab70ca0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86db8599-3bc0-44ff-a97c-3e50694fc689', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a713e9d3-fbc8-4007-a641-2149f6de6e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume volume-86db8599-3bc0-44ff-a97c-3e50694fc689 (86db8599-3bc0-44ff-a97c-3e50694fc689): created successfully Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a713e9d3-fbc8-4007-a641-2149f6de6e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (939696c0-1093-4a26-a7aa-5c8d1edfa3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:40:38 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 Jul 28 14:40:38 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (908ef2dc-fa1f-4515-9d64-8a5c979dadf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3ef16e-8e4d-4e23-805d-ecd4f9e9074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-18e1c761-78a8-4861-9414-df52e464a0f5 tempest-TestInstancesWithCinderVolumes-1397340250 None] Created volume successfully. Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3ef16e-8e4d-4e23-805d-ecd4f9e9074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805147945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6415380-8123-43fc-ada5-2049e709de1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:38Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8ecff11-e570-401d-b438-c6a4f30b7d44),volume_type_id=f8ecff11-e570-401d-b438-c6a4f30b7d44)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f40d0b-0308-4624-9712-35c62d410013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f40d0b-0308-4624-9712-35c62d410013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c773412-39be-4c3e-9131-b0a73ff4c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:40:38 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c773412-39be-4c3e-9131-b0a73ff4c182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6415380-8123-43fc-ada5-2049e709de1b', 'volume_name': 'volume-a6415380-8123-43fc-ada5-2049e709de1b', 'volume_size': 1, 'image_id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1652845374', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f445defe63e649de8684793a71f28413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb09770-d853-4aa5-b79d-595da7890f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb09770-d853-4aa5-b79d-595da7890f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30e97c0-0047-427e-9c89-9f3b961b5ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume a6415380-8123-43fc-ada5-2049e709de1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6415380-8123-43fc-ada5-2049e709de1b', 'volume_size': 1, 'image_id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1652845374', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f445defe63e649de8684793a71f28413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc/file', 'properties': {}}, 'image_service': } Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Trying to clone a6415380-8123-43fc-ada5-2049e709de1b from image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:38 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14 Jul 28 14:40:38 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:38 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 1073741824" returned: 0 in 0.463s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:38 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 Jul 28 14:40:38 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:38 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6b560e4a-e744-4b45-b0c7-40b769da1a14" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-6b560e4a-e744-4b45-b0c7-40b769da1a14" released by "delete_volume" :: held 0.765s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['c6ce071e-300e-4e51-8099-d1f3838cfa6a', '24fa93da-c41b-4bf1-9212-9f420f5db720', 'd8b1772b-b21e-48ab-8aa4-5ca7f04c1b4d', '415c7e5f-992a-459d-b64f-bce1fa08b199'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:38 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d87ef73-5b19-48f7-8a2d-dcfd2a5b4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0600d688-5807-49c1-9a19-14618fb977a0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ebb346-2481-404f-bea5-a542d0e948e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume volume-0600d688-5807-49c1-9a19-14618fb977a0 (0600d688-5807-49c1-9a19-14618fb977a0): created successfully Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ebb346-2481-404f-bea5-a542d0e948e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (582c9ac7-6b21-4aa6-b362-4041b3b1a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-660eb27a-d867-4165-bf0d-14aeda2167a4 tempest-TestInstancesWithCinderVolumes-1397340250 None] Created volume successfully. Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:38 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:38 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-15b09c98-f3a7-45dd-93d8-09f22bec0ed0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-15b09c98-f3a7-45dd-93d8-09f22bec0ed0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "cinder-quobyte-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6727b77f-cd72-45d1-9952-a8c56efbff9e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:39 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-10a88745-d17f-4298-bf04-31fb433ed15a tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-6b560e4a-e744-4b45-b0c7-40b769da1a14-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:39 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 Jul 28 14:40:39 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:39 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" returned: 0 in 0.381s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:39 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0 Jul 28 14:40:39 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:39 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-quobyte-15b09c98-f3a7-45dd-93d8-09f22bec0ed0" released by "delete_volume" :: held 0.672s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Created reservations ['e930feff-c910-40bd-be79-463aee5dd204', '49162c62-b67b-49c3-a71f-a902acb8b9ce', 'c9eaf0c9-5e4d-4154-93e1-a33d85425e75', '56ba3c02-f1f4-444f-a14a-e7af61433523'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:40 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:40 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:40 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:40 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Deleted volume successfully. Jul 28 14:40:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bbc9fb70-371b-45c4-bbe5-07a7defd99a7 tempest-CreateVolumesFromSourceVolumeTest-1799588482 None] Lock "cinder-15b09c98-f3a7-45dd-93d8-09f22bec0ed0-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD, size 20.69 MB, duration 3.57 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:40:42 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Image download 20.69 MB at 5.80 MB/s Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb510a-6e2d-4b9b-942a-2e79c1f4c07a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:42 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD Jul 28 14:40:42 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:42 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Temporary image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc is fetched for user 1d53246ea58647a9ad5c9ae4d7107271. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[175077ae-4e7c-46e1-b2e2-551b773d4365]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:42 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD Jul 28 14:40:42 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:42 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-805147945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6415380-8123-43fc-ada5-2049e709de1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f445defe63e649de8684793a71f28413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:40:38Z,use_quota=True,user_id='1d53246ea58647a9ad5c9ae4d7107271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8ecff11-e570-401d-b438-c6a4f30b7d44),volume_type_id=f8ecff11-e570-401d-b438-c6a4f30b7d44)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Creating volume a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:40:42 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:40:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:42 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1073741824 Jul 28 14:40:42 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:43 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1073741824" returned: 0 in 0.395s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:43 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b Jul 28 14:40:43 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:43 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=120,cinder:UPDATE=159,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=154,cinder:INSERT=42,cinder:SELECT=103,cinder:DELETE=15 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Attempting download of d45416ff-4d20-4cf2-a53f-3b67ef91a7dc ((None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}])) to volume a6415380-8123-43fc-ada5-2049e709de1b. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0039024-4506-4d12-a5fb-fe420d141c79]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:43 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl Jul 28 14:40:43 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:43 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl" returned: 0 in 0.315s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:43 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl Jul 28 14:40:43 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:44 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl" returned: 1 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_0ph47lgl' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cad044-c3bb-45db-93b6-81dc8aacbee9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:44 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD Jul 28 14:40:44 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:44 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] d45416ff-4d20-4cf2-a53f-3b67ef91a7dc was qcow2, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:40:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:44 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b Jul 28 14:40:44 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:46 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b" returned: 0 in 1.509s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d45416ff-4d20-4cf2-a53f-3b67ef91a7dc_zoyet7crdevstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:40:46 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Converted 112.00 MB image at 74.17 MB/s Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:46 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1G Jul 28 14:40:46 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:46 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b 1G" returned: 0 in 0.304s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Downloaded image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc ((None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}])) to volume a6415380-8123-43fc-ada5-2049e709de1b successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Temporary image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc for user 1d53246ea58647a9ad5c9ae4d7107271 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Marking volume a6415380-8123-43fc-ada5-2049e709de1b as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Copying metadata from image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc to a6415380-8123-43fc-ada5-2049e709de1b. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Creating volume glance metadata for volume a6415380-8123-43fc-ada5-2049e709de1b backed by image d45416ff-4d20-4cf2-a53f-3b67ef91a7dc with: {'image_id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'image_name': 'tempest-scenario-img--1652845374', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30e97c0-0047-427e-9c89-9f3b961b5ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6415380-8123-43fc-ada5-2049e709de1b', 'volume_size': 1, 'image_id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1652845374', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f445defe63e649de8684793a71f28413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd45416ff-4d20-4cf2-a53f-3b67ef91a7dc', 'created_at': datetime.datetime(2026, 7, 28, 12, 40, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d45416ff-4d20-4cf2-a53f-3b67ef91a7dc/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1037ee8-578d-4d29-93f7-56b7bf56994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:40:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Volume volume-a6415380-8123-43fc-ada5-2049e709de1b (a6415380-8123-43fc-ada5-2049e709de1b): created successfully Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1037ee8-578d-4d29-93f7-56b7bf56994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:40:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Flow 'volume_create_manager' (908ef2dc-fa1f-4515-9d64-8a5c979dadf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:40:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3eee2f50-92ef-49f7-8145-595e6624cadf tempest-TestInstancesWithCinderVolumes-1397340250 None] Created volume successfully. Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:40:49 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:40:49 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:40:49 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.253s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-b29bdbea-b2d9-4c8c-b527-a55364dcb33f req-6a140ae8-ec34-426a-ae39-a35e6f6f65ef tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-b29bdbea-b2d9-4c8c-b527-a55364dcb33f req-6a140ae8-ec34-426a-ae39-a35e6f6f65ef tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-b29bdbea-b2d9-4c8c-b527-a55364dcb33f req-6a140ae8-ec34-426a-ae39-a35e6f6f65ef tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:40:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-b29bdbea-b2d9-4c8c-b527-a55364dcb33f req-6a140ae8-ec34-426a-ae39-a35e6f6f65ef tempest-TestInstancesWithCinderVolumes-1397340250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-a6415380-8123-43fc-ada5-2049e709de1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b87f810-e9ec-4b89-bba8-f7e5d65f298f', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:40:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-b29bdbea-b2d9-4c8c-b527-a55364dcb33f req-6a140ae8-ec34-426a-ae39-a35e6f6f65ef tempest-TestInstancesWithCinderVolumes-1397340250 None] attachment_update completed successfully. Jul 28 14:40:59 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:40:59 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=5,cinder:SELECT=11,cinder:INSERT=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:41:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-211c9587-d087-4e68-8a59-8bc97ec26221 req-f705c8ed-46ba-4c93-a7c6-c610151accb9 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-211c9587-d087-4e68-8a59-8bc97ec26221 req-f705c8ed-46ba-4c93-a7c6-c610151accb9 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-211c9587-d087-4e68-8a59-8bc97ec26221 req-f705c8ed-46ba-4c93-a7c6-c610151accb9 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-211c9587-d087-4e68-8a59-8bc97ec26221 req-f705c8ed-46ba-4c93-a7c6-c610151accb9 tempest-TestInstancesWithCinderVolumes-1397340250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-86db8599-3bc0-44ff-a97c-3e50694fc689', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e8cf0ea-c449-40fb-b080-4acd47224198', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:41:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-211c9587-d087-4e68-8a59-8bc97ec26221 req-f705c8ed-46ba-4c93-a7c6-c610151accb9 tempest-TestInstancesWithCinderVolumes-1397340250 None] attachment_update completed successfully. Jul 28 14:41:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-06ee3cc1-59d5-40a7-afa1-145c6534670c req-d67b0c36-82a7-4fc1-8fb4-60d582a7b480 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-06ee3cc1-59d5-40a7-afa1-145c6534670c req-d67b0c36-82a7-4fc1-8fb4-60d582a7b480 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-06ee3cc1-59d5-40a7-afa1-145c6534670c req-d67b0c36-82a7-4fc1-8fb4-60d582a7b480 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-06ee3cc1-59d5-40a7-afa1-145c6534670c req-d67b0c36-82a7-4fc1-8fb4-60d582a7b480 tempest-TestInstancesWithCinderVolumes-1397340250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-0600d688-5807-49c1-9a19-14618fb977a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4a4e4b9-0b9a-4aa0-9bd0-38131378ef6c', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:41:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-06ee3cc1-59d5-40a7-afa1-145c6534670c req-d67b0c36-82a7-4fc1-8fb4-60d582a7b480 tempest-TestInstancesWithCinderVolumes-1397340250 None] attachment_update completed successfully. Jul 28 14:41:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-b3b8e232-a75a-4498-8a25-af1fb3ee12c0 req-9172a976-dc54-4c1d-ba6a-f7cadc391958 tempest-TestInstancesWithCinderVolumes-1397340250 None] Terminate volume connection completed successfully. Jul 28 14:41:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-b3b8e232-a75a-4498-8a25-af1fb3ee12c0 req-9172a976-dc54-4c1d-ba6a-f7cadc391958 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleting attachment 0e8cf0ea-c449-40fb-b080-4acd47224198. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-86db8599-3bc0-44ff-a97c-3e50694fc689-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-86db8599-3bc0-44ff-a97c-3e50694fc689-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-quobyte-86db8599-3bc0-44ff-a97c-3e50694fc689" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-86db8599-3bc0-44ff-a97c-3e50694fc689" acquired by "delete_volume" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[01678412-39eb-4819-99c3-4fdb0c0f37e9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:27 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 Jul 28 14:41:27 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:27 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:27 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689 Jul 28 14:41:27 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:28 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-86db8599-3bc0-44ff-a97c-3e50694fc689" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-86db8599-3bc0-44ff-a97c-3e50694fc689" released by "delete_volume" :: held 0.655s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:28 devstack cinder-volume[87385]: WARNING cinder.quota [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1392855563-485200092 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1392855563-485200092, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:28 devstack cinder-volume[87385]: WARNING cinder.quota [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1392855563-485200092 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1392855563-485200092, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Created reservations ['b2a32513-b413-4139-99aa-aa56293b2fc2', '9a80540b-4f88-4cf8-94c1-409176086b2c', 'f06180fd-d72d-4900-95bc-900eaef92617', 'bba224e9-98f2-4b06-b101-60231c767837'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:28 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:41:28 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:28 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:41:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleted volume successfully. Jul 28 14:41:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-cf964e22-a383-42d2-b902-9d3f53780818 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-86db8599-3bc0-44ff-a97c-3e50694fc689-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:30 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-330e6c36-f67b-4c61-b2fc-c54a5432c06c req-08be4067-e163-43d4-bc38-1868fcab7a00 tempest-TestInstancesWithCinderVolumes-1397340250 None] Terminate volume connection completed successfully. Jul 28 14:41:30 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-330e6c36-f67b-4c61-b2fc-c54a5432c06c req-08be4067-e163-43d4-bc38-1868fcab7a00 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleting attachment f4a4e4b9-0b9a-4aa0-9bd0-38131378ef6c. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-0600d688-5807-49c1-9a19-14618fb977a0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-0600d688-5807-49c1-9a19-14618fb977a0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-quobyte-0600d688-5807-49c1-9a19-14618fb977a0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-0600d688-5807-49c1-9a19-14618fb977a0" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634c3e1-a10d-4f9c-8a03-efbaaf5848a1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:31 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 Jul 28 14:41:31 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:31 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0" returned: 0 in 0.380s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:31 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0 Jul 28 14:41:31 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:32 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0600d688-5807-49c1-9a19-14618fb977a0" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-0600d688-5807-49c1-9a19-14618fb977a0" released by "delete_volume" :: held 0.686s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:32 devstack cinder-volume[87385]: WARNING cinder.quota [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1131231493-256223834 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1131231493-256223834, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:32 devstack cinder-volume[87385]: WARNING cinder.quota [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1131231493-256223834 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1131231493-256223834, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Created reservations ['a27661cf-98d2-46d6-bdb7-d24593a1e84d', '86522d98-46b8-4a4a-a491-eb33b20b5dc6', 'f9875c93-951e-42ea-b33f-a1abd7b4e3b3', '0e84fed6-64d1-4230-aa7a-0d7babbefd5c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:32 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:41:32 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:32 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:41:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleted volume successfully. Jul 28 14:41:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1d34c9c6-e0c8-4f8d-b605-b9a005878019 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-0600d688-5807-49c1-9a19-14618fb977a0-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-9f325e47-6d1d-4153-8398-cd47588e7eb5 req-60263e72-dd79-4f59-84c8-c0035d90d464 tempest-TestInstancesWithCinderVolumes-1397340250 None] Terminate volume connection completed successfully. Jul 28 14:41:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-9f325e47-6d1d-4153-8398-cd47588e7eb5 req-60263e72-dd79-4f59-84c8-c0035d90d464 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleting attachment 4b87f810-e9ec-4b89-bba8-f7e5d65f298f. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-a6415380-8123-43fc-ada5-2049e709de1b-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-a6415380-8123-43fc-ada5-2049e709de1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "cinder-quobyte-a6415380-8123-43fc-ada5-2049e709de1b" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-a6415380-8123-43fc-ada5-2049e709de1b" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae67c0-310f-447d-898d-4a404cc656c7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:36 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b Jul 28 14:41:36 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:36 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b" returned: 0 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:36 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b Jul 28 14:41:36 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:36 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a6415380-8123-43fc-ada5-2049e709de1b" returned: 0 in 0.245s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-quobyte-a6415380-8123-43fc-ada5-2049e709de1b" released by "delete_volume" :: held 0.632s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283606123-1802430393 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283606123-1802430393, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:36 devstack cinder-volume[87385]: WARNING cinder.quota [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283606123-1802430393 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283606123-1802430393, it is now deprecated. Please use the default quota class for default quota. Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Created reservations ['8216d381-f229-497c-ac48-b16005ce845a', '066264cc-f0aa-4591-afa9-682231a56203', 'f0aee9b2-8292-47eb-ba90-781069f29132', 'd9d8abf4-fb97-449f-9db4-8d49cd7d6c7d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:36 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:41:36 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:37 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:41:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Deleted volume successfully. Jul 28 14:41:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d2cb06d3-1b71-4465-9374-0eac3e997a70 tempest-TestInstancesWithCinderVolumes-1397340250 None] Lock "cinder-a6415380-8123-43fc-ada5-2049e709de1b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:41:47 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:41:49 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:41:49 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:41:49 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:41:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:41:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:INSERT=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Flow 'volume_create_manager' (02d8da7b-6e19-45ed-8edd-261c228096f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23fdf45-3f92-4f43-9313-6a5e542ba2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23fdf45-3f92-4f43-9313-6a5e542ba2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-838802623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474b033d-545f-4a5b-92cf-9a778ac3c171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c7907cb25645a58ea93299ed0d3483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:42:12Z,use_quota=True,user_id='9b69ec532eed4006a788cbbd0a2aa2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a08ff49-041b-415d-8154-c7e36abd7446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a08ff49-041b-415d-8154-c7e36abd7446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0b683f-b8f4-49ff-a7a8-65318b41e9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0b683f-b8f4-49ff-a7a8-65318b41e9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474b033d-545f-4a5b-92cf-9a778ac3c171', 'volume_name': 'volume-474b033d-545f-4a5b-92cf-9a778ac3c171', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c129a60-6f04-47fe-8db0-9bc4797b8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c129a60-6f04-47fe-8db0-9bc4797b8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3eaa774-3248-4d49-af68-3d4d0afe6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Volume 474b033d-545f-4a5b-92cf-9a778ac3c171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474b033d-545f-4a5b-92cf-9a778ac3c171', 'volume_size': 1} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-838802623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474b033d-545f-4a5b-92cf-9a778ac3c171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c7907cb25645a58ea93299ed0d3483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:42:12Z,use_quota=True,user_id='9b69ec532eed4006a788cbbd0a2aa2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Creating volume 474b033d-545f-4a5b-92cf-9a778ac3c171 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:42:12 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:42:12 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 1073741824 Jul 28 14:42:12 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:42:12 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 1073741824" returned: 0 in 0.437s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:42:12 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 Jul 28 14:42:12 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:42:12 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171" returned: 0 in 0.280s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3eaa774-3248-4d49-af68-3d4d0afe6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474b033d-545f-4a5b-92cf-9a778ac3c171', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534ac994-9b6d-429c-a8cc-2690a89fb61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:42:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Volume volume-474b033d-545f-4a5b-92cf-9a778ac3c171 (474b033d-545f-4a5b-92cf-9a778ac3c171): created successfully Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534ac994-9b6d-429c-a8cc-2690a89fb61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:42:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Flow 'volume_create_manager' (02d8da7b-6e19-45ed-8edd-261c228096f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:42:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c016a5b5-8f02-41cd-be37-bd1a61068dd6 tempest-TestMinimumBasicScenario-810553405 None] Created volume successfully. Jul 28 14:42:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-8b7b8cfb-585f-4252-8a4f-52897abc6da6 req-c9079cc7-e05c-47b4-a1b9-c007072567b3 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:42:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-8b7b8cfb-585f-4252-8a4f-52897abc6da6 req-c9079cc7-e05c-47b4-a1b9-c007072567b3 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:42:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-8b7b8cfb-585f-4252-8a4f-52897abc6da6 req-c9079cc7-e05c-47b4-a1b9-c007072567b3 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:42:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-8b7b8cfb-585f-4252-8a4f-52897abc6da6 req-c9079cc7-e05c-47b4-a1b9-c007072567b3 tempest-TestMinimumBasicScenario-810553405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-474b033d-545f-4a5b-92cf-9a778ac3c171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48724c32-8fab-4a76-aaab-aae72350d8b6', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:42:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-8b7b8cfb-585f-4252-8a4f-52897abc6da6 req-c9079cc7-e05c-47b4-a1b9-c007072567b3 tempest-TestMinimumBasicScenario-810553405 None] attachment_update completed successfully. Jul 28 14:42:23 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:42:23 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:42:49 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:42:49 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:42:49 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.247s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:42:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:43:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-f6744ffd-ccef-40e2-9fa1-0ff6b11720fe req-6cad4a02-f147-4ffb-8d72-3180620e4f50 tempest-TestMinimumBasicScenario-810553405 None] Terminate volume connection completed successfully. Jul 28 14:43:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-f6744ffd-ccef-40e2-9fa1-0ff6b11720fe req-6cad4a02-f147-4ffb-8d72-3180620e4f50 tempest-TestMinimumBasicScenario-810553405 None] Deleting attachment 48724c32-8fab-4a76-aaab-aae72350d8b6. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "cinder-474b033d-545f-4a5b-92cf-9a778ac3c171-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "cinder-474b033d-545f-4a5b-92cf-9a778ac3c171-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "cinder-quobyte-474b033d-545f-4a5b-92cf-9a778ac3c171" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "cinder-quobyte-474b033d-545f-4a5b-92cf-9a778ac3c171" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4020afdb-96d5-4368-b3e1-4595ecfbb88c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:02 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 Jul 28 14:43:02 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:02 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:02 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171 Jul 28 14:43:02 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:02 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-474b033d-545f-4a5b-92cf-9a778ac3c171" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "cinder-quobyte-474b033d-545f-4a5b-92cf-9a778ac3c171" released by "delete_volume" :: held 0.636s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Created reservations ['65602e3b-b451-412c-98a8-53abede44805', '5bc22f66-a921-436e-8e5d-5d8ef5edd488', '3420bd70-a6da-4276-b28e-ca3580a17180', '1129ef7d-cd95-4659-9c14-892a424343b9'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:43:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:02 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:43:02 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:03 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:03 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:43:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Deleted volume successfully. Jul 28 14:43:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-90b31d90-51d8-4b72-b551-d8c32797cbd9 tempest-TestMinimumBasicScenario-810553405 None] Lock "cinder-474b033d-545f-4a5b-92cf-9a778ac3c171-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:43:12 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:43:13 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:43:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Flow 'volume_create_manager' (2781643d-ad86-4278-9e64-0e2cd3555916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d55dae-090f-4afc-92a0-47068a25930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d55dae-090f-4afc-92a0-47068a25930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-975672415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2b735-4b94-444d-b64f-2a7fb14844c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19316256de43f9a87de915a0a43595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:43:33Z,use_quota=True,user_id='8eb8a2a9cfec4fe0ac93170cb1b4af27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f802d-9eb6-41cc-959d-5262c85bfd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f802d-9eb6-41cc-959d-5262c85bfd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb3ed6-b1ab-40c2-b891-e2dc0b5d18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb3ed6-b1ab-40c2-b891-e2dc0b5d18e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b2b735-4b94-444d-b64f-2a7fb14844c1', 'volume_name': 'volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36673039-1685-4202-9e9a-4c0c33383654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36673039-1685-4202-9e9a-4c0c33383654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a477dd0c-09e4-4410-beb1-55e4fb300e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Volume c6b2b735-4b94-444d-b64f-2a7fb14844c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1', 'volume_size': 1} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-975672415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2b735-4b94-444d-b64f-2a7fb14844c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19316256de43f9a87de915a0a43595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:43:33Z,use_quota=True,user_id='8eb8a2a9cfec4fe0ac93170cb1b4af27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Creating volume c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:43:33 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:33 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 1073741824 Jul 28 14:43:33 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:33 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 1073741824" returned: 0 in 0.442s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:33 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:43:33 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:33 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a477dd0c-09e4-4410-beb1-55e4fb300e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fc372-cb31-4c17-8186-b97f805d55e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:43:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Volume volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 (c6b2b735-4b94-444d-b64f-2a7fb14844c1): created successfully Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fc372-cb31-4c17-8186-b97f805d55e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:43:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Flow 'volume_create_manager' (2781643d-ad86-4278-9e64-0e2cd3555916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:43:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e0bbeb52-aea2-4efb-8763-9d3c98f253e1 tempest-TestStampPattern-1835546800 None] Created volume successfully. Jul 28 14:43:43 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:43:43 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:43:49 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:43:49 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:43:49 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:43:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:43:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:43:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=1 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:44:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-abe167db-8c13-4ad7-802c-dff8b0e7d255 req-252f91c9-28d2-4e6b-96bb-828fb97159e4 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-abe167db-8c13-4ad7-802c-dff8b0e7d255 req-252f91c9-28d2-4e6b-96bb-828fb97159e4 tempest-TestStampPattern-1835546800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-abe167db-8c13-4ad7-802c-dff8b0e7d255 req-252f91c9-28d2-4e6b-96bb-828fb97159e4 tempest-TestStampPattern-1835546800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-abe167db-8c13-4ad7-802c-dff8b0e7d255 req-252f91c9-28d2-4e6b-96bb-828fb97159e4 tempest-TestStampPattern-1835546800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24c151ca-f556-443a-88f6-b373b1b9f2c5', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:44:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-abe167db-8c13-4ad7-802c-dff8b0e7d255 req-252f91c9-28d2-4e6b-96bb-828fb97159e4 tempest-TestStampPattern-1835546800 None] attachment_update completed successfully. Jul 28 14:44:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-dc363a56-0827-43c7-bfcd-fee0f375ea3e req-45220961-7e59-489c-865b-700fd6d383d3 tempest-TestStampPattern-1835546800 None] Terminate volume connection completed successfully. Jul 28 14:44:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-dc363a56-0827-43c7-bfcd-fee0f375ea3e req-45220961-7e59-489c-865b-700fd6d383d3 tempest-TestStampPattern-1835546800 None] Deleting attachment 24c151ca-f556-443a-88f6-b373b1b9f2c5. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Creating offline snapshot 3e89f94a-ec68-459b-81c8-d6c87e8c8d31 of volume c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee233a7-170d-4086-b289-40d0f1079901]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:08 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:44:08 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:08 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.366s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:08 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 1G Jul 28 14:44:08 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:09 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 1G" returned: 0 in 0.383s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:09 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:44:09 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:09 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.284s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:09 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 is being set with open permissions: ugo+rw Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:09 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:44:09 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:09 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:09 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info Jul 28 14:44:09 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:09 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:09 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info is being set with open permissions: ugo+rw Jul 28 14:44:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:09 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info Jul 28 14:44:09 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:10 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.info" returned: 0 in 0.236s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bca59cb7-a7f1-4a3b-86bd-52a5ccfce541 tempest-TestStampPattern-1835546800 None] Create snapshot completed successfully Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Flow 'volume_create_manager' (35d3f56a-4622-44fd-8ed9-b4eabed728f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb7babf-2f93-4c6d-83df-149bce2f0f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb7babf-2f93-4c6d-83df-149bce2f0f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2100508034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d044b10-5e99-4de7-aabf-16ce506da9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19316256de43f9a87de915a0a43595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e89f94a-ec68-459b-81c8-d6c87e8c8d31,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:44:17Z,use_quota=True,user_id='8eb8a2a9cfec4fe0ac93170cb1b4af27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ad9e6-01a7-4ac3-86fe-7729b18e126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ad9e6-01a7-4ac3-86fe-7729b18e126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555e3542-c2a4-4d7f-953b-a6c94e540ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555e3542-c2a4-4d7f-953b-a6c94e540ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d044b10-5e99-4de7-aabf-16ce506da9b5', 'volume_name': 'volume-0d044b10-5e99-4de7-aabf-16ce506da9b5', 'volume_size': 1, 'snapshot_id': '3e89f94a-ec68-459b-81c8-d6c87e8c8d31'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47e69db-1486-4352-8005-2a4024884dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47e69db-1486-4352-8005-2a4024884dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07abd777-2986-41b3-9e41-85b591c5e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:17 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Volume 0d044b10-5e99-4de7-aabf-16ce506da9b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d044b10-5e99-4de7-aabf-16ce506da9b5', 'volume_size': 1, 'snapshot_id': '3e89f94a-ec68-459b-81c8-d6c87e8c8d31'} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-0d044b10-5e99-4de7-aabf-16ce506da9b5" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-0d044b10-5e99-4de7-aabf-16ce506da9b5" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Creating volume 0d044b10-5e99-4de7-aabf-16ce506da9b5 from snapshot 3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] snapshot: 3e89f94a-ec68-459b-81c8-d6c87e8c8d31, volume: 0d044b10-5e99-4de7-aabf-16ce506da9b5, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32ad4f-1f06-4908-b0a8-0e6ec97f8675]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:17 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:44:17 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:17 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.361s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf94022-c270-4166-9bdd-44e849efce80]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:44:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:17 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:44:17 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:18 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:18 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:44:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:18 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 Jul 28 14:44:18 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:23 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5" returned: 0 in 5.532s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f9f44-a01e-4fe1-8346-22a2e5845c96]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:44:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:23 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:44:23 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:24 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.608s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:44:24 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Converted 1024.00 MB image at 185.07 MB/s Jul 28 14:44:24 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 is being set with open permissions: ugo+rw Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:24 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 Jul 28 14:44:24 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:24 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" released by "_copy_volume_from_snapshot" :: held 7.259s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-0d044b10-5e99-4de7-aabf-16ce506da9b5" released by "_create_volume_from_snapshot" :: held 7.296s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.310s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07abd777-2986-41b3-9e41-85b591c5e120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d044b10-5e99-4de7-aabf-16ce506da9b5', 'volume_size': 1, 'snapshot_id': '3e89f94a-ec68-459b-81c8-d6c87e8c8d31'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd02520-38da-4f6d-8d79-f24cd83da74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:44:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Volume volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 (0d044b10-5e99-4de7-aabf-16ce506da9b5): created successfully Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd02520-38da-4f6d-8d79-f24cd83da74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:44:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Flow 'volume_create_manager' (35d3f56a-4622-44fd-8ed9-b4eabed728f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:44:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a6283712-7eb7-4ecb-a0a2-cb5b59a4f739 tempest-TestStampPattern-1835546800 None] Created volume successfully. Jul 28 14:44:34 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:44:34 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:44:49 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:44:49 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:44:49 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.232s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:44:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[787922d8-3161-4411-9e0d-1dbbe7e9aad1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:06 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 Jul 28 14:45:06 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:06 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.377s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726', 'name': 'volume-0d044b10-5e99-4de7-aabf-16ce506da9b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca9375f1-81a7-4a72-832c-9d784fb5d0c3', 'enforce_multipath': True} {{(pid=87385) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 28 14:45:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-bd0b2728-0475-44ef-a9f2-2956c699bbd8 req-4410bb62-3444-4b86-9dec-2e8fffa9b232 tempest-TestStampPattern-1835546800 None] attachment_update completed successfully. Jul 28 14:45:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [req-a92bef69-4145-4aec-af60-4b9bfa44afa0 req-86a92ec6-f0b7-4a45-982a-83a767e81617 tempest-TestStampPattern-1835546800 None] Terminate volume connection completed successfully. Jul 28 14:45:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [req-a92bef69-4145-4aec-af60-4b9bfa44afa0 req-86a92ec6-f0b7-4a45-982a-83a767e81617 tempest-TestStampPattern-1835546800 None] Deleting attachment ca9375f1-81a7-4a72-832c-9d784fb5d0c3. {{(pid=87385) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 28 14:45:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-0d044b10-5e99-4de7-aabf-16ce506da9b5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "cinder-0d044b10-5e99-4de7-aabf-16ce506da9b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" acquired by "delete_volume" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bcce7b-9e0f-483d-8778-1719b6812b83]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:14 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 Jul 28 14:45:14 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:14 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5" returned: 0 in 0.350s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:14 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5 Jul 28 14:45:14 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:14 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-0d044b10-5e99-4de7-aabf-16ce506da9b5" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-0d044b10-5e99-4de7-aabf-16ce506da9b5" released by "delete_volume" :: held 0.628s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Created reservations ['e0c95d95-b6a8-4cfc-92ee-f2b0b57a6320', '050326e0-e0e0-404e-ad22-61c434334233', '168ab6ab-8265-4470-bd80-33f3e2e35a32', '5695aff6-741a-4874-b625-a487fe6b1bc7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:14 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:14 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:15 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Deleted volume successfully. Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-32160e5f-2da1-407a-875a-b51576da8169 tempest-TestStampPattern-1835546800 None] Lock "cinder-0d044b10-5e99-4de7-aabf-16ce506da9b5-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Deleting offline snapshot 3e89f94a-ec68-459b-81c8-d6c87e8c8d31 of volume c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] snapshot_file for this snap is: volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[631bb3ab-914f-4f75-b012-93677db15ca7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:15 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:45:15 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:15 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.354s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[141d6a09-f710-424d-aca2-3ee4fe538500]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:15 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:45:15 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:16 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:16 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:45:16 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:16 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:16 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31 Jul 28 14:45:16 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:16 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1.3e89f94a-ec68-459b-81c8-d6c87e8c8d31" returned: 0 in 0.244s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-3e89f94a-ec68-459b-81c8-d6c87e8c8d31" released by "_delete_snapshot" :: held 1.360s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" released by "delete_snapshot" :: held 1.380s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Created reservations ['8e2fbe2e-86d6-477f-9d18-5d9e72054417', 'c557e756-c2c5-4377-a877-4b07474979f8', 'd5744cfb-89bd-41ec-b37f-f17e17259aa2', '631c240f-dc65-4722-9ac5-7ef829d866d6'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Delete snapshot completed successfully. Jul 28 14:45:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b7d5b5fd-c2b7-4d1b-87c6-8300769da771 tempest-TestStampPattern-1835546800 None] Lock "cinder-3e89f94a-ec68-459b-81c8-d6c87e8c8d31-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-c6b2b735-4b94-444d-b64f-2a7fb14844c1-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "cinder-c6b2b735-4b94-444d-b64f-2a7fb14844c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Acquiring lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27548d8-6ef4-46b8-8d33-d5a438b410f5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:21 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:45:21 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:21 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:21 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1 Jul 28 14:45:21 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:21 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c6b2b735-4b94-444d-b64f-2a7fb14844c1" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "cinder-quobyte-c6b2b735-4b94-444d-b64f-2a7fb14844c1" released by "delete_volume" :: held 0.643s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Created reservations ['abaca00e-4c15-4a1d-8611-0226ab0a93c0', '737e122e-f178-481d-b84f-78cae33e706f', '2fcd89fc-178b-4611-9ddc-edf3cb49742c', '3ddf6fd5-ce7f-4f67-a410-47e215b11e9a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:21 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:21 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:21 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Deleted volume successfully. Jul 28 14:45:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ccdf7199-1220-48ce-bd16-cf4cde4582c9 tempest-TestStampPattern-1835546800 None] Lock "cinder-c6b2b735-4b94-444d-b64f-2a7fb14844c1-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (9aec1b28-80e6-49a2-871c-795009f0019b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a885e0-ea6a-4c64-8255-653c94613c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a885e0-ea6a-4c64-8255-653c94613c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-460626229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e51708-a54c-4890-b9b7-7fc255159b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:31Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73456d9-2c12-48ee-bc24-3233bac94c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73456d9-2c12-48ee-bc24-3233bac94c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d2c44-b4c5-4c17-980b-31f9169c5911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951d2c44-b4c5-4c17-980b-31f9169c5911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e51708-a54c-4890-b9b7-7fc255159b9f', 'volume_name': 'volume-05e51708-a54c-4890-b9b7-7fc255159b9f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42249c9-5962-4cea-92d6-e080920611dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42249c9-5962-4cea-92d6-e080920611dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965089f8-06de-4a9f-a2a3-0137dafaa578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Volume 05e51708-a54c-4890-b9b7-7fc255159b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e51708-a54c-4890-b9b7-7fc255159b9f', 'volume_size': 1} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-460626229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e51708-a54c-4890-b9b7-7fc255159b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:31Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Creating volume 05e51708-a54c-4890-b9b7-7fc255159b9f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:31 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:31 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f 1073741824 Jul 28 14:45:31 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (ab65b016-737d-4bc0-8d68-7e0c86060e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813beb73-8f03-4756-92b5-449f64cca235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813beb73-8f03-4756-92b5-449f64cca235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683987344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562a7bc5-f37d-401b-a03b-dbd202db2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b3418e-35d6-42f2-800a-17ce1f2813f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b3418e-35d6-42f2-800a-17ce1f2813f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9299162e-a1f4-45b5-9336-b53669b6f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9299162e-a1f4-45b5-9336-b53669b6f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562a7bc5-f37d-401b-a03b-dbd202db2c91', 'volume_name': 'volume-562a7bc5-f37d-401b-a03b-dbd202db2c91', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b82411-1250-4f25-8e86-b86b98fc5764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b82411-1250-4f25-8e86-b86b98fc5764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ae287d-5b1d-4d54-9642-e3c38ecf9a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Volume 562a7bc5-f37d-401b-a03b-dbd202db2c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562a7bc5-f37d-401b-a03b-dbd202db2c91', 'volume_size': 1} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:31 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f 1073741824" returned: 0 in 0.475s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:31 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f Jul 28 14:45:31 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (db6f97d0-392f-4ea3-9a3b-c4454d6f3264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65c64e-5000-456d-a1ed-c7e3947e0ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:31 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65c64e-5000-456d-a1ed-c7e3947e0ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412970824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79942f1e-298e-480f-9dec-a1a959780cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0a94b1-b66e-43e5-a4ce-d62e93138d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0a94b1-b66e-43e5-a4ce-d62e93138d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9752528-3b9e-4b08-8395-2724b5443524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9752528-3b9e-4b08-8395-2724b5443524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79942f1e-298e-480f-9dec-a1a959780cfa', 'volume_name': 'volume-79942f1e-298e-480f-9dec-a1a959780cfa', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c25bae-ed73-46b2-8c5e-90b6ad2e637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c25bae-ed73-46b2-8c5e-90b6ad2e637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa4be45-eafd-4822-af2c-2e7b72a2bb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Volume 79942f1e-298e-480f-9dec-a1a959780cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79942f1e-298e-480f-9dec-a1a959780cfa', 'volume_size': 1} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:32 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683987344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562a7bc5-f37d-401b-a03b-dbd202db2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Creating volume 562a7bc5-f37d-401b-a03b-dbd202db2c91 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965089f8-06de-4a9f-a2a3-0137dafaa578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e51708-a54c-4890-b9b7-7fc255159b9f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded3a732-d10c-483c-83a7-cc6c55c0247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 1073741824 Jul 28 14:45:32 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Volume volume-05e51708-a54c-4890-b9b7-7fc255159b9f (05e51708-a54c-4890-b9b7-7fc255159b9f): created successfully Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded3a732-d10c-483c-83a7-cc6c55c0247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (9aec1b28-80e6-49a2-871c-795009f0019b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3d052849-2b18-43eb-898a-3f6a4919d838 tempest-CreateVolumesFromImageTest-1670724815 None] Created volume successfully. Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (9cd10615-95fc-4f24-84ab-7e31abbe21ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62467cc9-5c6d-46bf-8509-6777dde5ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62467cc9-5c6d-46bf-8509-6777dde5ff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471035104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0707b0d-3795-407b-893c-ba971d4b8870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f24f83c-b0b2-4e9c-8654-336ff83eea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f24f83c-b0b2-4e9c-8654-336ff83eea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8efa9cb-87a4-4680-ae0c-35b0364249b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8efa9cb-87a4-4680-ae0c-35b0364249b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0707b0d-3795-407b-893c-ba971d4b8870', 'volume_name': 'volume-e0707b0d-3795-407b-893c-ba971d4b8870', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357110bc-1a3f-4ece-89d2-e0564f200bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357110bc-1a3f-4ece-89d2-e0564f200bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5feb44-7098-4c5c-8a37-009e37cb7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Volume e0707b0d-3795-407b-893c-ba971d4b8870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0707b0d-3795-407b-893c-ba971d4b8870', 'volume_size': 1} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (08d49fa1-cb9b-44a5-9446-17f730c2f83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b91ff-8a4f-42c4-a6a8-e5467045f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7b91ff-8a4f-42c4-a6a8-e5467045f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086752020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d6af4-bf2b-4549-8818-db920a398966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:33Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5fb907-c90e-4b0a-b9da-b88751d4245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5fb907-c90e-4b0a-b9da-b88751d4245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83a7bc-5c79-4e09-9397-39581e1577a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af83a7bc-5c79-4e09-9397-39581e1577a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6d6af4-bf2b-4549-8818-db920a398966', 'volume_name': 'volume-6c6d6af4-bf2b-4549-8818-db920a398966', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec781123-0777-4016-af17-c09dfef1c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec781123-0777-4016-af17-c09dfef1c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f39cdc7-3b3f-4f5c-aeff-36d146f5fe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Volume 6c6d6af4-bf2b-4549-8818-db920a398966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6d6af4-bf2b-4549-8818-db920a398966', 'volume_size': 1} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 1073741824" returned: 0 in 0.605s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:32 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 Jul 28 14:45:32 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:33 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412970824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79942f1e-298e-480f-9dec-a1a959780cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Creating volume 79942f1e-298e-480f-9dec-a1a959780cfa {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ae287d-5b1d-4d54-9642-e3c38ecf9a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562a7bc5-f37d-401b-a03b-dbd202db2c91', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:33 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa 1073741824 Jul 28 14:45:33 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb09c249-5a94-4b83-a99b-865822af1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Volume volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 (562a7bc5-f37d-401b-a03b-dbd202db2c91): created successfully Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb09c249-5a94-4b83-a99b-865822af1f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (ab65b016-737d-4bc0-8d68-7e0c86060e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-61b3d74f-3409-4b52-841d-f7e2ddedf58a tempest-CreateVolumesFromImageTest-1670724815 None] Created volume successfully. Jul 28 14:45:33 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa 1073741824" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:33 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa Jul 28 14:45:33 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:33 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa" returned: 0 in 0.248s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471035104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0707b0d-3795-407b-893c-ba971d4b8870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:32Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Creating volume e0707b0d-3795-407b-893c-ba971d4b8870 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:33 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 1073741824 Jul 28 14:45:33 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa4be45-eafd-4822-af2c-2e7b72a2bb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79942f1e-298e-480f-9dec-a1a959780cfa', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe246fc-4f29-4ad2-a452-cc47a1aa5360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Volume volume-79942f1e-298e-480f-9dec-a1a959780cfa (79942f1e-298e-480f-9dec-a1a959780cfa): created successfully Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe246fc-4f29-4ad2-a452-cc47a1aa5360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (db6f97d0-392f-4ea3-9a3b-c4454d6f3264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4ce10870-7fe4-42ca-a6d0-1de9b742d927 tempest-CreateVolumesFromImageTest-1670724815 None] Created volume successfully. Jul 28 14:45:34 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 1073741824" returned: 0 in 0.421s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:34 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 Jul 28 14:45:34 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:34 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1086752020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d6af4-bf2b-4549-8818-db920a398966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313bab4433914655aa07b5173bfcbaee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:33Z,use_quota=True,user_id='cc59c791d4a84e84b348af63964585cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Creating volume 6c6d6af4-bf2b-4549-8818-db920a398966 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:34 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5feb44-7098-4c5c-8a37-009e37cb7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0707b0d-3795-407b-893c-ba971d4b8870', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:34 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 1073741824 Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a622ac24-0c57-456e-8a4a-ea62299d39c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:34 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:34 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Volume volume-e0707b0d-3795-407b-893c-ba971d4b8870 (e0707b0d-3795-407b-893c-ba971d4b8870): created successfully Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a622ac24-0c57-456e-8a4a-ea62299d39c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (9cd10615-95fc-4f24-84ab-7e31abbe21ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-be433645-11a0-427a-a972-de020a54a67f tempest-CreateVolumesFromImageTest-1670724815 None] Created volume successfully. Jul 28 14:45:34 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 1073741824" returned: 0 in 0.447s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:34 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 Jul 28 14:45:34 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:35 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f39cdc7-3b3f-4f5c-aeff-36d146f5fe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6d6af4-bf2b-4549-8818-db920a398966', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100e5608-e5da-43d5-ac6a-f2f26d26201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:35 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Volume volume-6c6d6af4-bf2b-4549-8818-db920a398966 (6c6d6af4-bf2b-4549-8818-db920a398966): created successfully Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100e5608-e5da-43d5-ac6a-f2f26d26201d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:35 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Flow 'volume_create_manager' (08d49fa1-cb9b-44a5-9446-17f730c2f83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3630c31c-4e52-4ea0-998d-3f5746cd94a9 tempest-CreateVolumesFromImageTest-1670724815 None] Created volume successfully. Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-6c6d6af4-bf2b-4549-8818-db920a398966-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-6c6d6af4-bf2b-4549-8818-db920a398966-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-quobyte-6c6d6af4-bf2b-4549-8818-db920a398966" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-6c6d6af4-bf2b-4549-8818-db920a398966" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[07592e1a-aee9-43f6-bc73-38f931552ba8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:36 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 Jul 28 14:45:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:36 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966" returned: 0 in 0.344s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:36 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966 Jul 28 14:45:36 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:36 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-6c6d6af4-bf2b-4549-8818-db920a398966" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-6c6d6af4-bf2b-4549-8818-db920a398966" released by "delete_volume" :: held 0.622s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Created reservations ['bb7e6780-4c5c-4590-be66-ab3c8698d23e', 'a4dabb88-7990-40e3-8875-40417a337f44', 'b6b6d664-4324-4670-b168-590ace3b841c', 'b66749b2-d141-4dad-bede-4754de43cc21'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:36 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:36 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:37 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.235s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Deleted volume successfully. Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a19f9b21-9f0b-4529-aeaf-aefbf6da6a8d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-6c6d6af4-bf2b-4549-8818-db920a398966-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-e0707b0d-3795-407b-893c-ba971d4b8870-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-e0707b0d-3795-407b-893c-ba971d4b8870-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-quobyte-e0707b0d-3795-407b-893c-ba971d4b8870" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-e0707b0d-3795-407b-893c-ba971d4b8870" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa9f0c4-b9e4-4ab3-a050-7ccf157a86cc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:37 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 Jul 28 14:45:37 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:37 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870" returned: 0 in 0.357s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:37 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870 Jul 28 14:45:37 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:37 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0707b0d-3795-407b-893c-ba971d4b8870" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-e0707b0d-3795-407b-893c-ba971d4b8870" released by "delete_volume" :: held 0.638s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:37 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Created reservations ['ef2df5f8-433c-4fcd-bed1-43b748c72e55', 'db0e5fdb-51bc-4871-828e-63c3554aaddf', '49268bb0-19c0-4956-859a-33d444a2b7de', '64b46ee6-ea77-4a47-8809-de68de1a2769'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:38 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:38 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:38 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.232s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:38 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Deleted volume successfully. Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-88554d55-876e-4c2f-aeab-7be610fae0e4 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-e0707b0d-3795-407b-893c-ba971d4b8870-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-79942f1e-298e-480f-9dec-a1a959780cfa-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-79942f1e-298e-480f-9dec-a1a959780cfa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-quobyte-79942f1e-298e-480f-9dec-a1a959780cfa" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-79942f1e-298e-480f-9dec-a1a959780cfa" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea199c-78b2-4c90-9d77-921241ceea39]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:38 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa Jul 28 14:45:38 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:38 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa" returned: 0 in 0.354s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:38 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa Jul 28 14:45:38 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:39 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-79942f1e-298e-480f-9dec-a1a959780cfa" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-79942f1e-298e-480f-9dec-a1a959780cfa" released by "delete_volume" :: held 0.631s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Created reservations ['a29ecc88-5651-4e6f-81dc-bf019528bc00', '0d515343-883b-4b07-af62-c1b984f5b8fc', 'eff18fa4-7593-4840-8e72-8eb2473937aa', '115e4bcc-b4e0-4cec-bcf2-213fcf04beb2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:39 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:39 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:39 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.236s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:39 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Deleted volume successfully. Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1b9ab3f1-6fde-4590-9c83-c37f6744251a tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-79942f1e-298e-480f-9dec-a1a959780cfa-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-562a7bc5-f37d-401b-a03b-dbd202db2c91-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-562a7bc5-f37d-401b-a03b-dbd202db2c91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-quobyte-562a7bc5-f37d-401b-a03b-dbd202db2c91" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-562a7bc5-f37d-401b-a03b-dbd202db2c91" acquired by "delete_volume" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98c9f8-221c-4b0b-8309-7380c4c5ea30]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:39 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 Jul 28 14:45:39 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:40 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91" returned: 0 in 0.346s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:40 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91 Jul 28 14:45:40 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:40 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-562a7bc5-f37d-401b-a03b-dbd202db2c91" returned: 0 in 0.233s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-562a7bc5-f37d-401b-a03b-dbd202db2c91" released by "delete_volume" :: held 0.615s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Created reservations ['e4896da4-c7c6-4312-baae-562936f13c08', 'e9403dd7-3503-4eb5-909e-b251bd0cbdd9', '974ce357-ba55-46a2-af5b-af63b048c026', 'a790b883-f737-4baa-93fa-a3616251ec60'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:40 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:40 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:40 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Deleted volume successfully. Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e267ad1b-d323-4924-9b68-08ac810da9c0 tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-562a7bc5-f37d-401b-a03b-dbd202db2c91-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-05e51708-a54c-4890-b9b7-7fc255159b9f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-05e51708-a54c-4890-b9b7-7fc255159b9f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "cinder-quobyte-05e51708-a54c-4890-b9b7-7fc255159b9f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-05e51708-a54c-4890-b9b7-7fc255159b9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea37c0-d2d0-45ff-8a68-23651558c2c2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:45:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:40 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f Jul 28 14:45:40 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:41 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f" returned: 0 in 0.341s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:41 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f Jul 28 14:45:41 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:41 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05e51708-a54c-4890-b9b7-7fc255159b9f" returned: 0 in 0.237s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-quobyte-05e51708-a54c-4890-b9b7-7fc255159b9f" released by "delete_volume" :: held 0.615s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Created reservations ['562afd5f-67d9-4095-b617-e6adf058a031', '0358d351-cc79-4ff2-a194-267e2f8935dc', '999896e9-06f7-427e-9759-777d9f336570', '9ae50d35-adf2-4d69-9bbc-9c9359097f7f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:41 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:41 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:41 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.234s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:41 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Deleted volume successfully. Jul 28 14:45:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b6b18b25-36dd-4b35-9073-8b65c089b31d tempest-CreateVolumesFromImageTest-1670724815 None] Lock "cinder-05e51708-a54c-4890-b9b7-7fc255159b9f-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:49 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:45:49 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:49 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:45:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:45:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=61,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:45:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=56,cinder:UPDATE=83,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (7f9cb89f-c58e-4296-8ffd-72aeb693483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bccce1-e670-4106-b097-2aa923cf51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bccce1-e670-4106-b097-2aa923cf51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1055092266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97391c2-fb71-4a98-a6f2-aca56688bc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:57Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7226c82-280d-447a-94c2-81c134874bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7226c82-280d-447a-94c2-81c134874bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bf96e7-4753-4489-8f50-c450f2befce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bf96e7-4753-4489-8f50-c450f2befce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97391c2-fb71-4a98-a6f2-aca56688bc36', 'volume_name': 'volume-b97391c2-fb71-4a98-a6f2-aca56688bc36', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d29c0af-b466-4191-b089-41ed7f55bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d29c0af-b466-4191-b089-41ed7f55bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae04d5f-20d5-4903-90ee-8b772e683c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume b97391c2-fb71-4a98-a6f2-aca56688bc36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97391c2-fb71-4a98-a6f2-aca56688bc36', 'volume_size': 1} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1055092266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97391c2-fb71-4a98-a6f2-aca56688bc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:57Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume b97391c2-fb71-4a98-a6f2-aca56688bc36 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:57 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:57 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 1073741824 Jul 28 14:45:57 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (a2565591-5605-4358-92ec-e01de47eeec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf5b38-0129-4d72-be38-2dee55effb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf5b38-0129-4d72-be38-2dee55effb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115897833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a27a9-1e21-4b09-9f63-d0ee2592bc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:58Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931fcf0-2b81-42e7-bd0f-f96960f87f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5931fcf0-2b81-42e7-bd0f-f96960f87f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f158dad0-ca43-43fa-b9a6-c3cb38ed3d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f158dad0-ca43-43fa-b9a6-c3cb38ed3d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0a27a9-1e21-4b09-9f63-d0ee2592bc51', 'volume_name': 'volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddeb5af-3e8c-4498-bbc5-5b4edaacda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddeb5af-3e8c-4498-bbc5-5b4edaacda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ad5b4b-f69f-45a6-8197-680b60813177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume bd0a27a9-1e21-4b09-9f63-d0ee2592bc51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51', 'volume_size': 1} Jul 28 14:45:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:58 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 1073741824" returned: 0 in 0.553s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:58 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 Jul 28 14:45:58 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:58 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115897833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a27a9-1e21-4b09-9f63-d0ee2592bc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:45:58Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:45:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae04d5f-20d5-4903-90ee-8b772e683c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97391c2-fb71-4a98-a6f2-aca56688bc36', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:58 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 1073741824 Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b1db0e-726b-43ef-8ffe-344540447018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:58 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 (b97391c2-fb71-4a98-a6f2-aca56688bc36): created successfully Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b1db0e-726b-43ef-8ffe-344540447018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (7f9cb89f-c58e-4296-8ffd-72aeb693483f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-40ecac31-b6b1-40af-a54e-474fe4191b8f tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:45:59 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 1073741824" returned: 0 in 0.537s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:45:59 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 Jul 28 14:45:59 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:45:59 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" returned: 0 in 0.275s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ad5b4b-f69f-45a6-8197-680b60813177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a432f21-3081-4ee1-901e-7fbfcfdc3319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:45:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 (bd0a27a9-1e21-4b09-9f63-d0ee2592bc51): created successfully Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a432f21-3081-4ee1-901e-7fbfcfdc3319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:45:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (a2565591-5605-4358-92ec-e01de47eeec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:45:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4490589a-6022-4193-95e9-602e611892b5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (6963804f-27df-493b-96d6-0abd1c9af622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90101717-0e9a-4470-a67b-1a8b0ee824ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90101717-0e9a-4470-a67b-1a8b0ee824ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769078913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038a16f1-0104-4efd-a904-38ca909e580d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:00Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cb58f7-1408-476e-9342-22512f59a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cb58f7-1408-476e-9342-22512f59a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c636dba-f202-4b0f-9cd0-e8855082d78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c636dba-f202-4b0f-9cd0-e8855082d78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038a16f1-0104-4efd-a904-38ca909e580d', 'volume_name': 'volume-038a16f1-0104-4efd-a904-38ca909e580d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263c8f34-cce9-4b5d-b1e9-dfb05fea9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263c8f34-cce9-4b5d-b1e9-dfb05fea9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa572b-fea3-4e80-8afc-c908c8a39f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume 038a16f1-0104-4efd-a904-38ca909e580d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038a16f1-0104-4efd-a904-38ca909e580d', 'volume_size': 1} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769078913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038a16f1-0104-4efd-a904-38ca909e580d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:00Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume 038a16f1-0104-4efd-a904-38ca909e580d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:00 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:00 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d 1073741824 Jul 28 14:46:00 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:00 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d 1073741824" returned: 0 in 0.712s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:00 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d Jul 28 14:46:00 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:00 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (99ca0923-7cbf-4511-ad96-e477f3cb644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc853108-1288-420a-807e-7fc5ad533e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc853108-1288-420a-807e-7fc5ad533e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425905357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3e8a0-8038-4d89-8a5f-6db7234c65c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:01Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f95654c-b807-4dcb-a523-f2940866e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f95654c-b807-4dcb-a523-f2940866e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe35c5d-f633-4827-a017-b7fea91a9798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe35c5d-f633-4827-a017-b7fea91a9798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd3e8a0-8038-4d89-8a5f-6db7234c65c3', 'volume_name': 'volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde6efd-5396-4121-a515-fd55271e7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde6efd-5396-4121-a515-fd55271e7da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4dab8b-a5b2-4ede-a9ab-20874fb5d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume 1bd3e8a0-8038-4d89-8a5f-6db7234c65c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3', 'volume_size': 1} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:01 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.251s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating offline snapshot 36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 of volume bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aa572b-fea3-4e80-8afc-c908c8a39f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038a16f1-0104-4efd-a904-38ca909e580d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5305bb9-cea1-471e-a99f-5873bd44e34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4abf24-ca0d-4e80-b611-83f7afe30494]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:01 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-038a16f1-0104-4efd-a904-38ca909e580d (038a16f1-0104-4efd-a904-38ca909e580d): created successfully Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5305bb9-cea1-471e-a99f-5873bd44e34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (6963804f-27df-493b-96d6-0abd1c9af622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bcc5552c-e7fd-4a2d-8303-169285a248c8 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:46:01 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 Jul 28 14:46:01 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Flow 'volume_create_manager' (90469062-6a89-4516-a05b-3d8a43f6d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937794ec-1ff7-49a7-ba2f-8b78bd1cfbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937794ec-1ff7-49a7-ba2f-8b78bd1cfbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e32e6c0c2747f197b82e3dbb772f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='a70c55b321e0433e8c0dbd8fd952a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7699617e-641f-4c70-9cac-96096b5ae714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7699617e-641f-4c70-9cac-96096b5ae714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa1dcd6-e64d-48bb-bfde-86456bb6b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" returned: 0 in 0.591s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:01 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 1G Jul 28 14:46:01 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (4db81e38-cf34-457d-8d36-7a36e1b87fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884405b-0dae-4272-b136-85c25707a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884405b-0dae-4272-b136-85c25707a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556108153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0cec4-c018-4d57-8a90-46b7c8a6f986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc69c6-1308-49ff-8917-0b5e1b91b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc69c6-1308-49ff-8917-0b5e1b91b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b2e746-295a-4cdf-a400-621fd3486ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b2e746-295a-4cdf-a400-621fd3486ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e0cec4-c018-4d57-8a90-46b7c8a6f986', 'volume_name': 'volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49259257-ed2f-4253-a739-680843d4e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49259257-ed2f-4253-a739-680843d4e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b66cc-fe95-48db-9713-56e6a5636e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume 92e0cec4-c018-4d57-8a90-46b7c8a6f986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986', 'volume_size': 1} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (4ac9134d-1a23-4397-9ede-d2c423a082d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9779730-7ea4-4ed6-8216-5457f8cacbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9779730-7ea4-4ed6-8216-5457f8cacbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791173194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b37be8-2df4-4bd8-8ae8-75ed29504a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fba615-fbb5-48ca-86bc-f3bd7832edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fba615-fbb5-48ca-86bc-f3bd7832edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b492a479-ee1d-485d-a8c2-1f8d9c0b1a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b492a479-ee1d-485d-a8c2-1f8d9c0b1a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b37be8-2df4-4bd8-8ae8-75ed29504a89', 'volume_name': 'volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313c80df-3b4b-4d52-97e4-4df22e3b912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313c80df-3b4b-4d52-97e4-4df22e3b912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90c5b7c-e50e-44ad-aa2d-6b04044d739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume 33b37be8-2df4-4bd8-8ae8-75ed29504a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89', 'volume_size': 1} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa1dcd6-e64d-48bb-bfde-86456bb6b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd', 'volume_name': 'volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd', 'volume_size': 1, 'image_id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1013b1446511d065a13fc61b80ced6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07e32e6c0c2747f197b82e3dbb772f27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd9817d3f97a6a5fd1fc88aa42073c62e9e558abff482cfa6637a4b34e850f544fa08cfe516bfb782215c94aec39bbd7de5496fd62bb89774e69748d7c727ed', 'id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da995ba3-4db9-4a7d-a6f0-211519a6e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da995ba3-4db9-4a7d-a6f0-211519a6e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d434ae4d-856b-4a4a-af1b-cf33fd038cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd', 'volume_size': 1, 'image_id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1013b1446511d065a13fc61b80ced6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07e32e6c0c2747f197b82e3dbb772f27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd9817d3f97a6a5fd1fc88aa42073c62e9e558abff482cfa6637a4b34e850f544fa08cfe516bfb782215c94aec39bbd7de5496fd62bb89774e69748d7c727ed', 'id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe/file', 'properties': {}}, 'image_service': } Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Trying to clone e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd from image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe at location (None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Flow 'volume_create_manager' (fe48fb2d-7281-41b6-9547-671603ebeabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1dd1f7-7e68-49e2-86e2-31b840889661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1dd1f7-7e68-49e2-86e2-31b840889661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed12d2c-4347-483b-8143-c5087886d0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54e6cd7385d4b1d9f7215726f87dfcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='be68a7fb2a604487b8cbc9450e3f1c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3d7005-3a2c-4fd5-801c-b1fc09b934c0),volume_type_id=6b3d7005-3a2c-4fd5-801c-b1fc09b934c0)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff689d-5f0e-4f13-9bb9-12a36146f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff689d-5f0e-4f13-9bb9-12a36146f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e029eb-aaf8-4a07-8d02-66128e1f68a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.image.glance [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Creating Keystone auth plugin from conf {{(pid=87385) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:02 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (869017b2-5052-458d-8db8-9d98684ccf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7e97ba-674d-4ce4-8880-c644b40382e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 1G" returned: 0 in 0.519s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Image download 0.00 MB at 0.00 MB/s Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7e97ba-674d-4ce4-8880-c644b40382e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077096224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b51233-e056-45c1-9df6-3992020b65f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b175418-a8ab-4b6a-9f24-975b3323c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b175418-a8ab-4b6a-9f24-975b3323c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1dbba4-080c-4032-8560-4de6a3285e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1dbba4-080c-4032-8560-4de6a3285e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b51233-e056-45c1-9df6-3992020b65f6', 'volume_name': 'volume-92b51233-e056-45c1-9df6-3992020b65f6', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f152c7-d51a-411c-b03a-1dc2147a66c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f152c7-d51a-411c-b03a-1dc2147a66c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd94ec22-aa6d-4c1d-a7ee-0128f0a78d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume 92b51233-e056-45c1-9df6-3992020b65f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b51233-e056-45c1-9df6-3992020b65f6', 'volume_size': 1} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb62f89b-a26b-4af2-a665-6337690d8616]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:02 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:02 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e029eb-aaf8-4a07-8d02-66128e1f68a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ed12d2c-4347-483b-8143-c5087886d0fe', 'volume_name': 'volume-8ed12d2c-4347-483b-8143-c5087886d0fe', 'volume_size': 1, 'image_id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd755b0325d62198bbc1454a6fbd21206', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f54e6cd7385d4b1d9f7215726f87dfcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '356ed12af52776defd9b31bbcfd435da0500144dcc6b7bb217075ec21b32ca8685dabef576d6911677b32f5fe6e7cc4a2b874b095b14ea6f05c918c1885e9d94', 'id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 46, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6143b52-dcb7-48f9-a53a-14302970ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6143b52-dcb7-48f9-a53a-14302970ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1998e8b7-efa6-4f09-9045-837dd258c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Volume 8ed12d2c-4347-483b-8143-c5087886d0fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ed12d2c-4347-483b-8143-c5087886d0fe', 'volume_size': 1, 'image_id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd755b0325d62198bbc1454a6fbd21206', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f54e6cd7385d4b1d9f7215726f87dfcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '356ed12af52776defd9b31bbcfd435da0500144dcc6b7bb217075ec21b32ca8685dabef576d6911677b32f5fe6e7cc4a2b874b095b14ea6f05c918c1885e9d94', 'id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 46, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Trying to clone 8ed12d2c-4347-483b-8143-c5087886d0fe from image ed3829be-de2b-4039-8efa-17bc0aff2ee4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}]). {{(pid=87385) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 28 14:46:02 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:02 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 is being set with open permissions: ugo+rw Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 28 14:46:02 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Image download 0.00 MB at 0.00 MB/s Jul 28 14:46:02 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 Jul 28 14:46:02 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9994f-e276-4d4d-8d8a-018fe11482e4]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:02 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:02 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" returned: 0 in 0.292s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info Jul 28 14:46:03 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Temporary image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe is fetched for user a70c55b321e0433e8c0dbd8fd952a694. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:46:03 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3914352b-a928-4349-8671-12242dca567e]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info is being set with open permissions: ugo+rw Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info Jul 28 14:46:03 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Temporary image ed3829be-de2b-4039-8efa-17bc0aff2ee4 is fetched for user be68a7fb2a604487b8cbc9450e3f1c97. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a6eb25-d316-4b23-828a-8c0d557d55cb]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.info" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.617s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425905357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3e8a0-8038-4d89-8a5f-6db7234c65c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:01Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume 1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:03 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:03 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 1073741824 Jul 28 14:46:03 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:03 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d59a36b1-007e-41dc-a088-a5e8fbef1cd5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Create snapshot completed successfully Jul 28 14:46:03 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:03 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:04 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:04 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:04 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:04 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:04 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 1073741824" returned: 0 in 0.466s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:04 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 Jul 28 14:46:04 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:04 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:04 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.435s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556108153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0cec4-c018-4d57-8a90-46b7c8a6f986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume 92e0cec4-c018-4d57-8a90-46b7c8a6f986 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:04 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4dab8b-a5b2-4ede-a9ab-20874fb5d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67e6a0-62a8-4d3e-9fec-327d18caf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:04 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 1073741824 Jul 28 14:46:04 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:04 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 (1bd3e8a0-8038-4d89-8a5f-6db7234c65c3): created successfully Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67e6a0-62a8-4d3e-9fec-327d18caf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (99ca0923-7cbf-4511-ad96-e477f3cb644f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a9ce5e0b-da7d-4028-bdfd-edef676357ed tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:46:04 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 1073741824" returned: 0 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:05 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 Jul 28 14:46:05 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:05 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.099s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-791173194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b37be8-2df4-4bd8-8ae8-75ed29504a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume 33b37be8-2df4-4bd8-8ae8-75ed29504a89 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:05 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b66cc-fe95-48db-9713-56e6a5636e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420ef35-0e38-418b-80f9-771ece410c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 1073741824 Jul 28 14:46:05 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 (92e0cec4-c018-4d57-8a90-46b7c8a6f986): created successfully Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8420ef35-0e38-418b-80f9-771ece410c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (4db81e38-cf34-457d-8d36-7a36e1b87fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (d594f437-96ae-455a-8a57-02e7324cca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12391794-e7fd-4a68-a16c-2704cdb8bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1c0a809e-1ea6-4b54-b45d-9fa65be2b30a tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12391794-e7fd-4a68-a16c-2704cdb8bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941600790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7b770f-1401-4e09-ad10-e9c76e27b03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:05Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d35a6-6ed7-428d-9e72-56c458f92ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699d35a6-6ed7-428d-9e72-56c458f92ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0998da-0994-4d7b-b449-4fb47a60e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0998da-0994-4d7b-b449-4fb47a60e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7b770f-1401-4e09-ad10-e9c76e27b03f', 'volume_name': 'volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b6354-a6c3-42c5-ad1a-c40df3e7cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b6354-a6c3-42c5-ad1a-c40df3e7cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea50d82d-e85b-4474-a398-5d3f556ff7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume 2c7b770f-1401-4e09-ad10-e9c76e27b03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f', 'volume_size': 1} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (37cf9395-1bbf-47a9-a0dd-a896396a8280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25589480-33b6-4d5b-8d32-1f7cb35148b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25589480-33b6-4d5b-8d32-1f7cb35148b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532449637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5cfdf3-9118-4d46-a053-3114fea07fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39117437-b0fd-4b96-b07f-84c2c6ef149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39117437-b0fd-4b96-b07f-84c2c6ef149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2871aa8e-b720-49e9-9639-0d56228da401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2871aa8e-b720-49e9-9639-0d56228da401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5cfdf3-9118-4d46-a053-3114fea07fea', 'volume_name': 'volume-8a5cfdf3-9118-4d46-a053-3114fea07fea', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7818ac1-506b-47b1-b69e-b6cd8d419abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7818ac1-506b-47b1-b69e-b6cd8d419abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd75ebab-7148-4b67-b11a-779b1248047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume 8a5cfdf3-9118-4d46-a053-3114fea07fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5cfdf3-9118-4d46-a053-3114fea07fea', 'volume_size': 1} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:05 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 1073741824" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:05 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 Jul 28 14:46:05 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (f0def43f-7ca8-4c16-8cc3-a53e7012a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14931285-6e6b-4a86-8456-0e9d9c8498e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14931285-6e6b-4a86-8456-0e9d9c8498e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1708957799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357313bf-9ba7-4bcf-b073-31d849df3535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30078ee7-1fa2-4817-88f4-8ee30d91facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30078ee7-1fa2-4817-88f4-8ee30d91facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7350ac5e-abda-40ea-a244-e519a98a64f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7350ac5e-abda-40ea-a244-e519a98a64f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357313bf-9ba7-4bcf-b073-31d849df3535', 'volume_name': 'volume-357313bf-9ba7-4bcf-b073-31d849df3535', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e67e7a4-d00d-4773-b7ec-6a749a57ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e67e7a4-d00d-4773-b7ec-6a749a57ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a382dbc-9e9a-4caa-8c75-31a5b22ce507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume 357313bf-9ba7-4bcf-b073-31d849df3535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357313bf-9ba7-4bcf-b073-31d849df3535', 'volume_size': 1} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89" returned: 0 in 0.324s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.622s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077096224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b51233-e056-45c1-9df6-3992020b65f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e44899c3aa041a594ecb27b9d93b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='ff299cf50ae44ffcbfbd7ae882242310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Creating volume 92b51233-e056-45c1-9df6-3992020b65f6 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90c5b7c-e50e-44ad-aa2d-6b04044d739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af20e65c-cc95-4021-b6f2-68d128213579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 1073741824 Jul 28 14:46:06 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 (33b37be8-2df4-4bd8-8ae8-75ed29504a89): created successfully Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af20e65c-cc95-4021-b6f2-68d128213579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (4ac9134d-1a23-4397-9ede-d2c423a082d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9119de5d-dfd1-40b5-b2a0-b095a5c0dc59 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (4a583ef6-4b20-4854-bb5b-fdcbc6cb0b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e5320-bdce-4bd4-aba6-23ea898586c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0e5320-bdce-4bd4-aba6-23ea898586c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064185683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2996a294-f5a8-4044-ba49-91e5b2c1ba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f857a9-75ef-4fcf-af20-942ae23b0d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f857a9-75ef-4fcf-af20-942ae23b0d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ee774-4c78-4718-9b63-f7a4864143d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ee774-4c78-4718-9b63-f7a4864143d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2996a294-f5a8-4044-ba49-91e5b2c1ba51', 'volume_name': 'volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb1290e-b83f-4ef3-95bc-ed982cc4c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb1290e-b83f-4ef3-95bc-ed982cc4c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995a697e-e212-4cc0-b3e0-57fc2b1cb84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume 2996a294-f5a8-4044-ba49-91e5b2c1ba51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51', 'volume_size': 1} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:06 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 1073741824" returned: 0 in 0.596s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:06 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 Jul 28 14:46:06 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (39ea760c-2fae-479e-8ef2-b8e6924c0b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f39d0c8-6580-424f-b1a0-995db47412f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f39d0c8-6580-424f-b1a0-995db47412f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-484613905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48ddd1c-5b21-4e41-94f0-8cf69f7a8961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:07Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bed07d-b2d3-484f-b4d7-3eaf18d03030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bed07d-b2d3-484f-b4d7-3eaf18d03030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326b08c7-ce7a-4376-9b17-7d9b15ac8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326b08c7-ce7a-4376-9b17-7d9b15ac8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48ddd1c-5b21-4e41-94f0-8cf69f7a8961', 'volume_name': 'volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c59f94b-a3cd-4351-9681-82754fb36082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c59f94b-a3cd-4351-9681-82754fb36082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96d6ca5-4132-4056-aabc-6c03d60d722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume e48ddd1c-5b21-4e41-94f0-8cf69f7a8961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961', 'volume_size': 1} Jul 28 14:46:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:07 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e32e6c0c2747f197b82e3dbb772f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='a70c55b321e0433e8c0dbd8fd952a694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Creating volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd94ec22-aa6d-4c1d-a7ee-0128f0a78d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b51233-e056-45c1-9df6-3992020b65f6', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:07 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1073741824 Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00adaeb-0ecb-4d32-ae6f-0010d52c36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:07 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:07 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Volume volume-92b51233-e056-45c1-9df6-3992020b65f6 (92b51233-e056-45c1-9df6-3992020b65f6): created successfully Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00adaeb-0ecb-4d32-ae6f-0010d52c36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Flow 'volume_create_manager' (869017b2-5052-458d-8db8-9d98684ccf5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9f31bf37-4430-4073-b9c1-18944652c488 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created volume successfully. Jul 28 14:46:07 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1073741824" returned: 0 in 0.419s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-92b51233-e056-45c1-9df6-3992020b65f6-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-92b51233-e056-45c1-9df6-3992020b65f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:07 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd Jul 28 14:46:07 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-92b51233-e056-45c1-9df6-3992020b65f6" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-92b51233-e056-45c1-9df6-3992020b65f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a7909-9921-4583-95da-d4ba1b7c5dae]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:07 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 Jul 28 14:46:07 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:07 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.427s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed12d2c-4347-483b-8143-c5087886d0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54e6cd7385d4b1d9f7215726f87dfcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:02Z,use_quota=True,user_id='be68a7fb2a604487b8cbc9450e3f1c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3d7005-3a2c-4fd5-801c-b1fc09b934c0),volume_type_id=6b3d7005-3a2c-4fd5-801c-b1fc09b934c0)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Creating volume 8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:07 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:07 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1073741824 Jul 28 14:46:07 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Attempting download of 01cc4171-44a5-41fd-8ff4-f1d3ae278afe ((None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}])) to volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c45357-1f09-41c5-822e-8c74ec4a771a]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:07 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6" returned: 0 in 0.392s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r Jul 28 14:46:08 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6 Jul 28 14:46:08 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1073741824" returned: 0 in 0.430s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r" returned: 0 in 0.346s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92b51233-e056-45c1-9df6-3992020b65f6" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-92b51233-e056-45c1-9df6-3992020b65f6" released by "delete_volume" :: held 0.725s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe Jul 28 14:46:08 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['65f2c60b-ca7c-458c-ada5-9131482e5811', 'd2398e51-1e4e-48d8-ae7f-b2cd30a9762c', 'd7df5058-5f3f-41f4-b4cf-36634ddf33c3', '17675089-893c-4059-ac0c-bf2a957f046f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:08 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r Jul 28 14:46:08 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:08 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe" returned: 0 in 0.331s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.223s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1941600790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7b770f-1401-4e09-ad10-e9c76e27b03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:05Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume 2c7b770f-1401-4e09-ad10-e9c76e27b03f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:08 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r" returned: 1 in 0.450s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_s8jbgr3r' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7508ec1-cd94-4f1c-a16d-20c1985f41a5]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f 1073741824 Jul 28 14:46:08 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-33b37be8-2df4-4bd8-8ae8-75ed29504a89-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:08 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Attempting download of ed3829be-de2b-4039-8efa-17bc0aff2ee4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}])) to volume 8ed12d2c-4347-483b-8143-c5087886d0fe. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-33b37be8-2df4-4bd8-8ae8-75ed29504a89-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c05ecf31-c35e-48b9-8681-f215c2cb74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-92b51233-e056-45c1-9df6-3992020b65f6-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-33b37be8-2df4-4bd8-8ae8-75ed29504a89" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-33b37be8-2df4-4bd8-8ae8-75ed29504a89" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc67337-74f9-4822-ac0a-c4086c13b8bc]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:08 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:08 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e4f957-fab2-451b-9ca1-e2e2ad1c1254]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m Jul 28 14:46:09 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 Jul 28 14:46:09 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f 1073741824" returned: 0 in 0.580s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m" returned: 0 in 0.365s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD Jul 28 14:46:09 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f Jul 28 14:46:09 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m Jul 28 14:46:09 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89 Jul 28 14:46:09 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] 01cc4171-44a5-41fd-8ff4-f1d3ae278afe was raw, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.831s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532449637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5cfdf3-9118-4d46-a053-3114fea07fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume 8a5cfdf3-9118-4d46-a053-3114fea07fea {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:09 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd Jul 28 14:46:09 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m" returned: 1 in 0.365s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed3829be-de2b-4039-8efa-17bc0aff2ee4_ar58ff8m' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe58b9-b87a-4670-9949-eccf56db193b]: (4, 'raw') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:09 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea 1073741824 Jul 28 14:46:09 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea50d82d-e85b-4474-a398-5d3f556ff7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8486138f-7bcb-4f10-9f6a-811fac75c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-33b37be8-2df4-4bd8-8ae8-75ed29504a89" returned: 0 in 0.302s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:09 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f (2c7b770f-1401-4e09-ad10-e9c76e27b03f): created successfully Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8486138f-7bcb-4f10-9f6a-811fac75c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (d594f437-96ae-455a-8a57-02e7324cca69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-33b37be8-2df4-4bd8-8ae8-75ed29504a89" released by "delete_volume" :: held 0.829s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d91eb3de-2c3d-4fc0-9c20-ba9d00196697 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['4985a435-7805-4239-b3aa-1988704e7d06', '334b02ea-3b2f-4701-ad83-5040840a2490', 'aa4d24da-ee0b-44df-9444-ab3ed8e2113a', '7d552a25-6b38-4abf-a80b-29a16735b72f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:09 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:09 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:09 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:09 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-92e0cec4-c018-4d57-8a90-46b7c8a6f986-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-92e0cec4-c018-4d57-8a90-46b7c8a6f986-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:10 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-92e0cec4-c018-4d57-8a90-46b7c8a6f986" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-92e0cec4-c018-4d57-8a90-46b7c8a6f986" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe18b22-21fc-4c27-a53d-76c175a72a41]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" returned: 0 in 0.671s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01cc4171-44a5-41fd-8ff4-f1d3ae278afe_ur8isbmidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD Jul 28 14:46:10 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.443s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea 1073741824" returned: 0 in 0.675s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:10 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1G Jul 28 14:46:10 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2d3fabd9-b02d-46e5-8962-81d3bcc9a41b tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-33b37be8-2df4-4bd8-8ae8-75ed29504a89-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 Jul 28 14:46:10 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea Jul 28 14:46:10 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] ed3829be-de2b-4039-8efa-17bc0aff2ee4 was raw, converting to qcow2 {{(pid=87385) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986" returned: 0 in 0.428s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe Jul 28 14:46:10 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd 1G" returned: 0 in 0.427s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Downloaded image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe ((None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}])) to volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Temporary image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe for user a70c55b321e0433e8c0dbd8fd952a694 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Marking volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:46:10 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986 Jul 28 14:46:10 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Copying metadata from image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe to e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Creating volume glance metadata for volume e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd backed by image 01cc4171-44a5-41fd-8ff4-f1d3ae278afe with: {'image_id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a1013b1446511d065a13fc61b80ced6a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:46:10 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.625s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1708957799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357313bf-9ba7-4bcf-b073-31d849df3535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume 357313bf-9ba7-4bcf-b073-31d849df3535 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:10 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 1073741824 Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd75ebab-7148-4b67-b11a-779b1248047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5cfdf3-9118-4d46-a053-3114fea07fea', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:10 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ecef33-9dc3-4189-92fd-0ea07fcb6910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-8a5cfdf3-9118-4d46-a053-3114fea07fea (8a5cfdf3-9118-4d46-a053-3114fea07fea): created successfully Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ecef33-9dc3-4189-92fd-0ea07fcb6910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (37cf9395-1bbf-47a9-a0dd-a896396a8280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d434ae4d-856b-4a4a-af1b-cf33fd038cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd', 'volume_size': 1, 'image_id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a1013b1446511d065a13fc61b80ced6a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07e32e6c0c2747f197b82e3dbb772f27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fd9817d3f97a6a5fd1fc88aa42073c62e9e558abff482cfa6637a4b34e850f544fa08cfe516bfb782215c94aec39bbd7de5496fd62bb89774e69748d7c727ed', 'id': '01cc4171-44a5-41fd-8ff4-f1d3ae278afe', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01cc4171-44a5-41fd-8ff4-f1d3ae278afe/file', 'properties': {}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f3f740-1b04-4c5f-b6d9-faf196f94018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b113c52c-0a3d-43f0-9fa9-f163505f8a00 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Volume volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd (e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd): created successfully Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f3f740-1b04-4c5f-b6d9-faf196f94018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Flow 'volume_create_manager' (90469062-6a89-4516-a05b-3d8a43f6d28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bcbeac61-9cc9-43ac-917a-126f3ebe8ee8 tempest-VolumeImageDependencyTests-1026852232 None] Created volume successfully. Jul 28 14:46:10 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-92e0cec4-c018-4d57-8a90-46b7c8a6f986" returned: 0 in 0.295s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-92e0cec4-c018-4d57-8a90-46b7c8a6f986" released by "delete_volume" :: held 0.795s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['e036c397-3da6-4bc3-b155-140b517cf1ed', '50731287-d717-46b8-9e89-8ef4834a1941', '1f098487-d0cf-4923-b9ed-651cbd00c6ac', '8d9624a2-9bd9-47af-9ebb-edc8acd70d71'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:11 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe" returned: 0 in 0.557s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed3829be-de2b-4039-8efa-17bc0aff2ee4_qfnryphvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Converted 0.00 MB image at 0.00 MB/s Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1G Jul 28 14:46:11 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:11 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 1073741824" returned: 0 in 0.560s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:11 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.322s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:11 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 Jul 28 14:46:11 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bb154719-5f71-4302-9ffe-7bd835ee74f4 tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-92e0cec4-c018-4d57-8a90-46b7c8a6f986-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77a2f7-25a5-4b93-963f-336fd6bfd849]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Acquiring lock "cinder-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "cinder-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:11 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Acquiring lock "cinder-quobyte-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe 1G" returned: 0 in 0.524s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Downloaded image ed3829be-de2b-4039-8efa-17bc0aff2ee4 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}])) to volume 8ed12d2c-4347-483b-8143-c5087886d0fe successfully. {{(pid=87385) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Temporary image ed3829be-de2b-4039-8efa-17bc0aff2ee4 for user be68a7fb2a604487b8cbc9450e3f1c97 is deleted. {{(pid=87385) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.volume_utils [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Marking volume 8ed12d2c-4347-483b-8143-c5087886d0fe as bootable. {{(pid=87385) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 28 14:46:11 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 Jul 28 14:46:11 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "cinder-quobyte-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Copying metadata from image ed3829be-de2b-4039-8efa-17bc0aff2ee4 to 8ed12d2c-4347-483b-8143-c5087886d0fe. {{(pid=87385) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Creating volume glance metadata for volume 8ed12d2c-4347-483b-8143-c5087886d0fe backed by image ed3829be-de2b-4039-8efa-17bc0aff2ee4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd755b0325d62198bbc1454a6fbd21206', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87385) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f321c-ba7b-4d4b-9d36-2daf06217a08]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535" returned: 0 in 0.436s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.321s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064185683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2996a294-f5a8-4044-ba49-91e5b2c1ba51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:06Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume 2996a294-f5a8-4044-ba49-91e5b2c1ba51 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1998e8b7-efa6-4f09-9045-837dd258c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed12d2c-4347-483b-8143-c5087886d0fe', 'volume_size': 1, 'image_id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd755b0325d62198bbc1454a6fbd21206', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f54e6cd7385d4b1d9f7215726f87dfcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '356ed12af52776defd9b31bbcfd435da0500144dcc6b7bb217075ec21b32ca8685dabef576d6911677b32f5fe6e7cc4a2b874b095b14ea6f05c918c1885e9d94', 'id': 'ed3829be-de2b-4039-8efa-17bc0aff2ee4', 'created_at': datetime.datetime(2026, 7, 28, 12, 45, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 28, 12, 46, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed3829be-de2b-4039-8efa-17bc0aff2ee4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:11 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450346da-9b32-46e9-a9a1-6a106a3eac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:11 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 1073741824 Jul 28 14:46:11 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Volume volume-8ed12d2c-4347-483b-8143-c5087886d0fe (8ed12d2c-4347-483b-8143-c5087886d0fe): created successfully Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450346da-9b32-46e9-a9a1-6a106a3eac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Flow 'volume_create_manager' (fe48fb2d-7281-41b6-9547-671603ebeabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a382dbc-9e9a-4caa-8c75-31a5b22ce507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357313bf-9ba7-4bcf-b073-31d849df3535', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0386014-c8ba-426c-8aa3-f693ecbed2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-eb380567-fb75-4cba-a49a-7efed3475403 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Created volume successfully. Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-357313bf-9ba7-4bcf-b073-31d849df3535 (357313bf-9ba7-4bcf-b073-31d849df3535): created successfully Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0386014-c8ba-426c-8aa3-f693ecbed2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:11 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (f0def43f-7ca8-4c16-8cc3-a53e7012a22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:11 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-04c788e3-fe0d-44a5-98b2-6199a0f48c82 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:12 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" returned: 0 in 0.536s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3 Jul 28 14:46:12 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" returned: 0 in 0.408s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd Jul 28 14:46:12 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3" released by "delete_volume" :: held 0.869s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:12 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 1073741824" returned: 0 in 0.494s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['e42d1803-269c-49e4-83a4-95440b7de225', 'ec22674c-5447-43e4-a205-9a798d0faa2c', 'ae825ce5-ffe4-415d-9d2c-b93f9397be8a', 'db7fbb0f-c99e-49c0-999e-fc8fc1d5d82d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 Jul 28 14:46:12 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "cinder-quobyte-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd" released by "delete_volume" :: held 0.749s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:12 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Created reservations ['b6999049-48a5-486c-9017-2a2fcaf60321', 'f1ffda7e-78df-48c4-a806-619fa1755163', '0288b309-5935-4156-9de4-4520e8442a6f', '03f2ce31-afbd-4075-bf7e-2a431c0dad1f'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:12 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51" returned: 0 in 0.383s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.868s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-484613905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48ddd1c-5b21-4e41-94f0-8cf69f7a8961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bc743ee0054736890a614c0e03038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:07Z,use_quota=True,user_id='b3f84a3196de4051abc28e0e0b40df81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Creating volume e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:12 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:12 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.343s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995a697e-e212-4cc0-b3e0-57fc2b1cb84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:12 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 1073741824 Jul 28 14:46:12 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bf1ea0-a1bc-48d7-b313-2c5ed88454b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 (2996a294-f5a8-4044-ba49-91e5b2c1ba51): created successfully Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bf1ea0-a1bc-48d7-b313-2c5ed88454b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (4a583ef6-4b20-4854-bb5b-fdcbc6cb0b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2a369639-a1ae-4d68-aefd-d4665b81e75e tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-1bd3e8a0-8038-4d89-8a5f-6db7234c65c3-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Acquiring lock "cinder-8ed12d2c-4347-483b-8143-c5087886d0fe-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a901861e-32b1-42d3-8b6a-133902b79461 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "cinder-8ed12d2c-4347-483b-8143-c5087886d0fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Acquiring lock "cinder-quobyte-8ed12d2c-4347-483b-8143-c5087886d0fe" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "cinder-quobyte-8ed12d2c-4347-483b-8143-c5087886d0fe" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa797874-443b-4997-a392-c785ddf20b8b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:13 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.473s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Deleted volume successfully. Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e2d0814e-f71a-4069-a39b-c2109319dc77 tempest-VolumeImageDependencyTests-1026852232 None] Lock "cinder-e480ad0b-b3d6-4ff2-a4ab-b216e143cdcd-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:13 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe Jul 28 14:46:13 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:13 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 1073741824" returned: 0 in 0.543s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:13 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 Jul 28 14:46:13 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:13 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe" returned: 0 in 0.451s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-038a16f1-0104-4efd-a904-38ca909e580d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:13 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe Jul 28 14:46:13 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-038a16f1-0104-4efd-a904-38ca909e580d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-038a16f1-0104-4efd-a904-38ca909e580d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-038a16f1-0104-4efd-a904-38ca909e580d" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:13 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[7844e208-c33c-48c9-b602-b93ec1c4107f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" returned: 0 in 0.315s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96d6ca5-4132-4056-aabc-6c03d60d722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101b7a2-5d14-460c-9c00-95798d4fa21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Volume volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 (e48ddd1c-5b21-4e41-94f0-8cf69f7a8961): created successfully Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101b7a2-5d14-460c-9c00-95798d4fa21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Flow 'volume_create_manager' (39ea760c-2fae-479e-8ef2-b8e6924c0b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a18f7c58-0e6c-4638-a686-43ce3008b070 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created volume successfully. Jul 28 14:46:13 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d Jul 28 14:46:13 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:13 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8ed12d2c-4347-483b-8143-c5087886d0fe" returned: 0 in 0.341s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "cinder-quobyte-8ed12d2c-4347-483b-8143-c5087886d0fe" released by "delete_volume" :: held 0.847s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:13 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Created reservations ['ec304fb8-8e28-4ae5-84cc-d3b4eae3a8e4', 'bf07d662-b3ea-4d16-a6cc-b78198bdc319', '5094d6d7-9eb6-4f07-bc70-10873af0376f', '0ea421aa-fbf7-47b6-aaa8-2949721c2223'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:14 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:14 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:14 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d" returned: 0 in 0.537s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:14 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d Jul 28 14:46:14 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" acquired by "delete_volume" :: waited 0.041s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b05fa7-72c1-469c-88c5-be9f0889e232]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:14 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.387s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:14 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Deleted volume successfully. Jul 28 14:46:14 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-038a16f1-0104-4efd-a904-38ca909e580d" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:14 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-038a16f1-0104-4efd-a904-38ca909e580d" released by "delete_volume" :: held 0.886s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:14 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-519b8c65-d1f4-4ae7-a732-461e97507f71 tempest-VolumeAndVolumeTypeFromImageTest-1014493993 None] Lock "cinder-8ed12d2c-4347-483b-8143-c5087886d0fe-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['d3fa6d2f-e46f-4893-b5b1-989b75c92302', '43b7132c-2343-4738-9b28-b16e6985d5c4', 'd3f18674-f184-4153-9488-0c0527e44569', '707f1dcc-fda8-4d5d-8249-28563810b3b1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:14 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:14 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-b97391c2-fb71-4a98-a6f2-aca56688bc36-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-b97391c2-fb71-4a98-a6f2-aca56688bc36-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "cinder-quobyte-b97391c2-fb71-4a98-a6f2-aca56688bc36" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:14 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" returned: 0 in 0.589s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-b97391c2-fb71-4a98-a6f2-aca56688bc36" acquired by "delete_volume" :: waited 0.044s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:15 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961 Jul 28 14:46:15 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e029b7e1-9556-497a-8c64-d60f20194821]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:15 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.379s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ab409b32-9a9c-4249-8fcb-aa6569ecb67d tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-038a16f1-0104-4efd-a904-38ca909e580d-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:15 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 Jul 28 14:46:15 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:15 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" returned: 0 in 0.310s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961" released by "delete_volume" :: held 0.964s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['6be35573-ce19-4c7c-be62-b6c7d0ad752d', '32c4aef7-92b4-4aba-aba9-c4efec7c31be', 'd517a42d-f808-41c3-971b-51da63c6b0c0', 'af505ff6-1865-4564-ad30-9d315c9460f9'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:15 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36" returned: 0 in 0.469s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:15 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:15 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:15 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36 Jul 28 14:46:15 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:15 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:15 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:15 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b97391c2-fb71-4a98-a6f2-aca56688bc36" returned: 0 in 0.314s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-quobyte-b97391c2-fb71-4a98-a6f2-aca56688bc36" released by "delete_volume" :: held 0.845s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a602c1d6-bc2b-4f13-ba52-42c0d6fa2cf5 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-e48ddd1c-5b21-4e41-94f0-8cf69f7a8961-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Created reservations ['bc2c159e-8497-4a82-af35-329bfd1345c3', '2d00138f-68c7-41d6-9cd9-0fda227b6b1b', 'ad9568b9-e19d-47e7-877e-74ad946f5336', '9c8df18a-c8e2-4a66-b3c1-bae355d67c19'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:16 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:16 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:16 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Deleted volume successfully. Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0c3e5e53-3f81-4942-bcf0-a82a1d2bd71c tempest-CreateVolumesFromSourceVolumeTest-1855608121 None] Lock "cinder-b97391c2-fb71-4a98-a6f2-aca56688bc36-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-2996a294-f5a8-4044-ba49-91e5b2c1ba51-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-2996a294-f5a8-4044-ba49-91e5b2c1ba51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-2996a294-f5a8-4044-ba49-91e5b2c1ba51" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-2996a294-f5a8-4044-ba49-91e5b2c1ba51" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a7960-3b74-48c7-b0b6-b2ce3b789cc1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:16 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 Jul 28 14:46:16 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:17 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51" returned: 0 in 0.505s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:17 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51 Jul 28 14:46:17 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:17 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2996a294-f5a8-4044-ba49-91e5b2c1ba51" returned: 0 in 0.356s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-2996a294-f5a8-4044-ba49-91e5b2c1ba51" released by "delete_volume" :: held 0.921s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e81592e9-6ac6-478b-af51-1653461e44e3 tempest-ProjectAdminTests-1706980525 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87385) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['6074af80-b395-4ab3-97eb-739303cebd91', '38d1d1e0-baae-430f-a5f0-3735a3b1b5fe', '21967fa7-4360-4033-8251-814f7c589b9e', 'c035028c-36b4-4ae2-865a-cbfad7212f5e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:17 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:17 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:18 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:18 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:18 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c1dc3b6b-e057-4149-aec9-d9711838b426 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-2996a294-f5a8-4044-ba49-91e5b2c1ba51-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-357313bf-9ba7-4bcf-b073-31d849df3535-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-357313bf-9ba7-4bcf-b073-31d849df3535-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-357313bf-9ba7-4bcf-b073-31d849df3535" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-357313bf-9ba7-4bcf-b073-31d849df3535" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044fd7a-549e-4ff2-b72e-d073440ef241]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:19 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 Jul 28 14:46:19 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:19 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535" returned: 0 in 0.473s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:19 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535 Jul 28 14:46:19 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:19 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-357313bf-9ba7-4bcf-b073-31d849df3535" returned: 0 in 0.340s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-357313bf-9ba7-4bcf-b073-31d849df3535" released by "delete_volume" :: held 0.874s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['f6e22a8d-b04c-4e2d-9031-43422f725c2d', 'a11233eb-bb90-40d9-be1f-b2de73e1944b', 'b87757bd-47f4-44e6-bcd4-b35933262b7e', '4e6e9946-e393-43fa-a5b5-0a15dac45d10'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:20 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:20 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-8a5cfdf3-9118-4d46-a053-3114fea07fea-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-8a5cfdf3-9118-4d46-a053-3114fea07fea-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (8f6f685c-8518-468c-82b0-3959b9f1f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42863dd-d340-4ca7-a3f1-5f2287c1dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42863dd-d340-4ca7-a3f1-5f2287c1dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1942034613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e07681c-7bf6-4b27-9f14-808c94ed14e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:20Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e97eb6-b273-4b6a-9f69-c2c9a6c2c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e97eb6-b273-4b6a-9f69-c2c9a6c2c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00abef49-43ff-46bc-8544-ecc608c7fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00abef49-43ff-46bc-8544-ecc608c7fba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e07681c-7bf6-4b27-9f14-808c94ed14e4', 'volume_name': 'volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27fc482-af19-49fe-9132-db86075ef9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27fc482-af19-49fe-9132-db86075ef9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ac6f1f-09c8-4afb-8f72-ea6bc0e79d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Volume 7e07681c-7bf6-4b27-9f14-808c94ed14e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4', 'volume_size': 1} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1942034613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e07681c-7bf6-4b27-9f14-808c94ed14e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:20Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Creating volume 7e07681c-7bf6-4b27-9f14-808c94ed14e4 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:20 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 1073741824 Jul 28 14:46:20 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-8a5cfdf3-9118-4d46-a053-3114fea07fea" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-8a5cfdf3-9118-4d46-a053-3114fea07fea" acquired by "delete_volume" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:20 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.498s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d394870-b85c-40fa-9188-c5f18f55a735]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3e150812-ab88-45c7-bf28-ed988b00098b tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-357313bf-9ba7-4bcf-b073-31d849df3535-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (9043a123-4710-464f-8b6f-c166c7438517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:20 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea Jul 28 14:46:20 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b6d5de-3a82-47d3-8069-1eccc826eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b6d5de-3a82-47d3-8069-1eccc826eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173871857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d60adc-85f4-4a24-b2aa-37644a6cd708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:21Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e4b3e1-e765-4b19-954a-fdab387fafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e4b3e1-e765-4b19-954a-fdab387fafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ec12a-a3df-4a3d-9f66-71694a6759ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ec12a-a3df-4a3d-9f66-71694a6759ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d60adc-85f4-4a24-b2aa-37644a6cd708', 'volume_name': 'volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5dfe88-97e1-4e40-9175-ed888093d5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5dfe88-97e1-4e40-9175-ed888093d5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3430638-2a3c-4bf5-9df4-4280dae5dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Volume a4d60adc-85f4-4a24-b2aa-37644a6cd708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708', 'volume_size': 1} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:21 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 1073741824" returned: 0 in 0.782s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:21 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 Jul 28 14:46:21 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:21 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea" returned: 0 in 0.844s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:21 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:21 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (046f0760-e94f-4f09-a996-51d41177b173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fff6fb-246d-42de-98fa-2e84fa1dcdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1fff6fb-246d-42de-98fa-2e84fa1dcdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1636250610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75daddd-0913-40e5-90b5-c7e908e216c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:21Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1834789-f481-48c4-928d-0ded7601ad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1834789-f481-48c4-928d-0ded7601ad3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96952b6c-d963-42b8-b62a-2827cee2f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96952b6c-d963-42b8-b62a-2827cee2f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75daddd-0913-40e5-90b5-c7e908e216c0', 'volume_name': 'volume-e75daddd-0913-40e5-90b5-c7e908e216c0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528610c-a402-4f8c-a535-9a60f148ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528610c-a402-4f8c-a535-9a60f148ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4ddbc4-f1ab-4558-8188-8f1c0607e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Volume e75daddd-0913-40e5-90b5-c7e908e216c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75daddd-0913-40e5-90b5-c7e908e216c0', 'volume_size': 1} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:21 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4" returned: 0 in 0.509s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173871857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d60adc-85f4-4a24-b2aa-37644a6cd708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:21Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Creating volume a4d60adc-85f4-4a24-b2aa-37644a6cd708 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:21 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:21 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:21 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 1073741824 Jul 28 14:46:21 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ac6f1f-09c8-4afb-8f72-ea6bc0e79d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2a4c18-954e-4925-82b3-21f2b46d44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8a5cfdf3-9118-4d46-a053-3114fea07fea" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:22 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Volume volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 (7e07681c-7bf6-4b27-9f14-808c94ed14e4): created successfully Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2a4c18-954e-4925-82b3-21f2b46d44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (8f6f685c-8518-468c-82b0-3959b9f1f82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-8a5cfdf3-9118-4d46-a053-3114fea07fea" released by "delete_volume" :: held 1.411s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-71e75f14-8752-45de-a9bd-75e59eb4d36e tempest-CreateVolumesFromImageTest-2093948105 None] Created volume successfully. Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (ba211203-0cd5-4a8f-b5ff-b45c47c19e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7610d078-6542-419c-8e8d-41e89975ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7610d078-6542-419c-8e8d-41e89975ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-862143820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c937c02c-a34f-41aa-a341-f132b5485c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:22Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eecdae1-fc20-4050-806a-9324ac48ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eecdae1-fc20-4050-806a-9324ac48ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8feb723-a602-476c-a84f-3a8ff62070ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8feb723-a602-476c-a84f-3a8ff62070ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c937c02c-a34f-41aa-a341-f132b5485c72', 'volume_name': 'volume-c937c02c-a34f-41aa-a341-f132b5485c72', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40943582-7398-4b2b-b326-5971bf5f42a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40943582-7398-4b2b-b326-5971bf5f42a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d57340-46f2-4d0e-b866-85800f0bf132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Volume c937c02c-a34f-41aa-a341-f132b5485c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c937c02c-a34f-41aa-a341-f132b5485c72', 'volume_size': 1} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['e0649e4b-e4ef-485d-85ad-727ef0383fd1', '54238cc8-52b9-4392-b438-5a29c2a47183', '285ef704-89e0-4a2b-8996-7f3c74437e06', '82eff124-94d5-4dbb-8ecb-e3fd6d9baac2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:22 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:22 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:22 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 1073741824" returned: 0 in 0.684s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:22 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:22 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 Jul 28 14:46:22 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.406s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-2c7b770f-1401-4e09-ad10-e9c76e27b03f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (ef58c2ff-59f0-4d29-a95d-f6aa946e20bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd246c2-672c-4771-8cdc-98a0c2a1b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-2c7b770f-1401-4e09-ad10-e9c76e27b03f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd246c2-672c-4771-8cdc-98a0c2a1b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294484735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a920790-254b-4b45-9a23-d05afd48af7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:23Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926fdb3c-b885-4560-974b-e59b2ddb0989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926fdb3c-b885-4560-974b-e59b2ddb0989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebae0ab-6129-43dd-a4a0-277fbeca1242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebae0ab-6129-43dd-a4a0-277fbeca1242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a920790-254b-4b45-9a23-d05afd48af7a', 'volume_name': 'volume-2a920790-254b-4b45-9a23-d05afd48af7a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92fe230-5bac-43a9-a97c-52dabe6479c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92fe230-5bac-43a9-a97c-52dabe6479c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31d8bef-78d4-48cd-ab09-c1127f21fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:22 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Volume 2a920790-254b-4b45-9a23-d05afd48af7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a920790-254b-4b45-9a23-d05afd48af7a', 'volume_size': 1} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-dea3ca6b-6818-4408-a409-039ffc97b009 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-8a5cfdf3-9118-4d46-a053-3114fea07fea-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-2c7b770f-1401-4e09-ad10-e9c76e27b03f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-2c7b770f-1401-4e09-ad10-e9c76e27b03f" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[12503e87-1565-402a-b27d-6bb921cd4079]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:23 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708" returned: 0 in 0.356s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1636250610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75daddd-0913-40e5-90b5-c7e908e216c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:21Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Creating volume e75daddd-0913-40e5-90b5-c7e908e216c0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:23 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3430638-2a3c-4bf5-9df4-4280dae5dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d25b11-1014-490b-8b22-cbdbd81b5090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:23 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 1073741824 Jul 28 14:46:23 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:23 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Volume volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 (a4d60adc-85f4-4a24-b2aa-37644a6cd708): created successfully Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d25b11-1014-490b-8b22-cbdbd81b5090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (9043a123-4710-464f-8b6f-c166c7438517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4d4302b3-e5da-4d2a-9a62-9c324ac5d9d3 tempest-CreateVolumesFromImageTest-2093948105 None] Created volume successfully. Jul 28 14:46:23 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f Jul 28 14:46:23 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:23 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f" returned: 0 in 0.469s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:23 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f Jul 28 14:46:23 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:23 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 1073741824" returned: 0 in 0.635s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:23 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2c7b770f-1401-4e09-ad10-e9c76e27b03f" returned: 0 in 0.320s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:23 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 Jul 28 14:46:23 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-2c7b770f-1401-4e09-ad10-e9c76e27b03f" released by "delete_volume" :: held 0.849s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['a519c0b7-210d-4947-b2ec-e4c5c2d6a1fd', '9eb6be86-dd4c-4333-90c3-ac6623ba4d48', 'e1f88905-3cd8-4b29-8644-5a556879a2fa', 'abc907c4-b214-450a-8049-ab29cab42ae2'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:23 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:23 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:24 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0" returned: 0 in 0.301s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-862143820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c937c02c-a34f-41aa-a341-f132b5485c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:22Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Creating volume c937c02c-a34f-41aa-a341-f132b5485c72 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:24 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4ddbc4-f1ab-4558-8188-8f1c0607e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75daddd-0913-40e5-90b5-c7e908e216c0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:24 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 1073741824 Jul 28 14:46:24 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf055db-968a-4e1c-a8d0-18c6a74f83a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Volume volume-e75daddd-0913-40e5-90b5-c7e908e216c0 (e75daddd-0913-40e5-90b5-c7e908e216c0): created successfully Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf055db-968a-4e1c-a8d0-18c6a74f83a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (046f0760-e94f-4f09-a996-51d41177b173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleting offline snapshot 36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 of volume bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] snapshot_file for this snap is: volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:46:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2264ec7f-ac55-478a-bef2-1018c3eee2a7 tempest-CreateVolumesFromImageTest-2093948105 None] Created volume successfully. Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[67203a59-41a4-485b-9b5e-fa47ad12b9cc]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:24 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.309s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:24 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-970ce184-e59b-470a-9cc3-b87fd56fb110 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-2c7b770f-1401-4e09-ad10-e9c76e27b03f-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:24 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 Jul 28 14:46:24 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:24 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 1073741824" returned: 0 in 0.569s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:24 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" returned: 0 in 0.472s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc22d90-a8ad-4f1a-8ee8-0b355fdcd08c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:24 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 Jul 28 14:46:24 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:24 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 Jul 28 14:46:24 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:25 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72" returned: 0 in 0.273s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1294484735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a920790-254b-4b45-9a23-d05afd48af7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61caca7d532417382d4cf1200737279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:23Z,use_quota=True,user_id='5c366f27add742a3a4b99ba9882b7995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Creating volume 2a920790-254b-4b45-9a23-d05afd48af7a {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:25 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:25 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a 1073741824 Jul 28 14:46:25 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d57340-46f2-4d0e-b866-85800f0bf132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c937c02c-a34f-41aa-a341-f132b5485c72', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a399a82-93ad-49b2-9878-ed16ef0720b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:25 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Volume volume-c937c02c-a34f-41aa-a341-f132b5485c72 (c937c02c-a34f-41aa-a341-f132b5485c72): created successfully Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a399a82-93ad-49b2-9878-ed16ef0720b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:25 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (ba211203-0cd5-4a8f-b5ff-b45c47c19e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" returned: 0 in 0.398s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-418c66e0-a8c3-4a6f-9204-e4447cc57237 tempest-CreateVolumesFromImageTest-2093948105 None] Created volume successfully. Jul 28 14:46:25 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 Jul 28 14:46:25 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:25 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" returned: 0 in 0.442s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:25 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31 Jul 28 14:46:25 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:25 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a 1073741824" returned: 0 in 0.585s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:25 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a Jul 28 14:46:25 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:26 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51.36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:26 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a" returned: 0 in 0.371s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31" released by "_delete_snapshot" :: held 1.948s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31d8bef-78d4-48cd-ab09-c1127f21fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a920790-254b-4b45-9a23-d05afd48af7a', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680cfc51-e2a7-4612-b914-57b1a0919974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" released by "delete_snapshot" :: held 2.047s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:26 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Volume volume-2a920790-254b-4b45-9a23-d05afd48af7a (2a920790-254b-4b45-9a23-d05afd48af7a): created successfully Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680cfc51-e2a7-4612-b914-57b1a0919974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Flow 'volume_create_manager' (ef58c2ff-59f0-4d29-a95d-f6aa946e20bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-befca875-66ed-4030-b08f-fc65cf617f25 tempest-CreateVolumesFromImageTest-2093948105 None] Created volume successfully. Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['ea560f03-aa20-435a-a37e-ef0ef2a4c764', '5cf9c053-0b97-4939-9755-4b6caa7c5c7f', '11a9fb72-a173-4efc-acdf-3b16cb8f899b', 'ca241f21-1da8-423d-a58f-d62871e57f92'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Delete snapshot completed successfully. Jul 28 14:46:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-86b7cdf8-98e7-4032-bb2b-4e447e1fdc48 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-36a9a3b3-d575-4ad4-ad2e-af5b8f8f8f31-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820c261-c94d-44dd-94b7-4e35d2698b97]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:27 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 Jul 28 14:46:27 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-2a920790-254b-4b45-9a23-d05afd48af7a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-2a920790-254b-4b45-9a23-d05afd48af7a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-quobyte-2a920790-254b-4b45-9a23-d05afd48af7a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-2a920790-254b-4b45-9a23-d05afd48af7a" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a7080-941c-4c74-a416-e99a4a319b42]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a102e1f3-9992-44b7-a868-209fc50f3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09c541-b7d8-4a4b-9d28-bf1c5432bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09c541-b7d8-4a4b-9d28-bf1c5432bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557649837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5403ef-fb74-419f-a6f5-182a8f7e7cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:28Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d91de-605b-472d-b2b3-022b49001e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d91de-605b-472d-b2b3-022b49001e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f069462-c297-4c48-bc81-8d35e8e8b251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f069462-c297-4c48-bc81-8d35e8e8b251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5403ef-fb74-419f-a6f5-182a8f7e7cc2', 'volume_name': 'volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf6750e-29b4-4ef8-af64-308bdcc2f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf6750e-29b4-4ef8-af64-308bdcc2f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6c2ae8-b22a-4efb-9227-0c0b4e266833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:27 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Volume af5403ef-fb74-419f-a6f5-182a8f7e7cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2', 'volume_size': 1} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557649837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5403ef-fb74-419f-a6f5-182a8f7e7cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:28Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Creating volume af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:27 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:27 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a Jul 28 14:46:27 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:27 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:27 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 1073741824 Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" returned: 0 in 0.491s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:27 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:28 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51 Jul 28 14:46:28 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:28 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-quobyte-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51" released by "delete_volume" :: held 0.834s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:28 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a" returned: 0 in 0.464s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:28 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a Jul 28 14:46:28 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Created reservations ['1ab1a784-cebc-404f-b4eb-170aae1e02c1', '12770f40-e631-4828-b753-102ad851867b', '90f92a50-4861-4244-8e1e-61808b16af23', '34341538-8a2f-4e94-ab95-8c20f2f0a384'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:28 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:28 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:28 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 1073741824" returned: 0 in 0.525s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:28 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 Jul 28 14:46:28 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:28 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2a920790-254b-4b45-9a23-d05afd48af7a" returned: 0 in 0.354s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-2a920790-254b-4b45-9a23-d05afd48af7a" released by "delete_volume" :: held 0.885s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Created reservations ['1482918a-501a-40e2-9705-0cd3f3debcfb', 'b71242aa-f9b0-4766-ba97-d66db957764c', '0bcc7df0-8465-4e17-a46e-ea99bbb15ae7', 'd64e7a79-1a4e-443b-9db6-4d4346f94eb7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:28 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Deleted volume successfully. Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c43eed62-abbb-4e16-bb8e-54675f58b097 tempest-CreateVolumesFromSnapshotTest-267426225 None] Lock "cinder-bd0a27a9-1e21-4b09-9f63-d0ee2592bc51-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:28 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" returned: 0 in 0.465s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6c2ae8-b22a-4efb-9227-0c0b4e266833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c06602-6f48-473e-9872-8edc6c65d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:29 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:29 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:29 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Volume volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 (af5403ef-fb74-419f-a6f5-182a8f7e7cc2): created successfully Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c06602-6f48-473e-9872-8edc6c65d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a102e1f3-9992-44b7-a868-209fc50f3145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d088fa2f-a6fb-45a9-86e8-25b87d5592c8 tempest-ProjectReaderTests-1572818496 None] Created volume successfully. Jul 28 14:46:29 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.294s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Deleted volume successfully. Jul 28 14:46:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-91940547-a412-4145-8ad7-5c58902d879b tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-2a920790-254b-4b45-9a23-d05afd48af7a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-c937c02c-a34f-41aa-a341-f132b5485c72-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-c937c02c-a34f-41aa-a341-f132b5485c72-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-quobyte-c937c02c-a34f-41aa-a341-f132b5485c72" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-c937c02c-a34f-41aa-a341-f132b5485c72" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0413e608-9e43-4e4f-aa84-d5d4173a3d6b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Creating offline snapshot a0a3d9c8-b018-4ca7-8589-834b2e50221b of volume af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac8bcbd-397a-46c5-83e7-a0d853459f78]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:30 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 Jul 28 14:46:30 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:30 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 Jul 28 14:46:30 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:30 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72" returned: 0 in 0.429s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:30 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72 Jul 28 14:46:30 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:30 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:30 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b 1G Jul 28 14:46:30 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:30 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-c937c02c-a34f-41aa-a341-f132b5485c72" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:30 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-c937c02c-a34f-41aa-a341-f132b5485c72" released by "delete_volume" :: held 0.851s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Created reservations ['9a14cdb8-50fd-46a2-8036-8e77b7fc0270', '80b98929-ae36-4dc3-bd33-5ab4f6e169cd', '84da8b83-d533-49ff-b16d-385c4e7e7326', '5963e823-1cb4-4459-9b76-beebd477012a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:31 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:31 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-e75daddd-0913-40e5-90b5-c7e908e216c0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-e75daddd-0913-40e5-90b5-c7e908e216c0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:31 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b 1G" returned: 0 in 0.646s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:31 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b Jul 28 14:46:31 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-quobyte-e75daddd-0913-40e5-90b5-c7e908e216c0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-e75daddd-0913-40e5-90b5-c7e908e216c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c277d-a530-47c0-a38f-9f006dea5193]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:31 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.402s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Deleted volume successfully. Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2bb19bab-b84b-4e4d-9b30-324993c4b2ed tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-c937c02c-a34f-41aa-a341-f132b5485c72-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:31 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 Jul 28 14:46:31 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:31 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:31 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b is being set with open permissions: ugo+rw Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:31 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b Jul 28 14:46:31 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:31 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0" returned: 0 in 0.519s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:32 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0 Jul 28 14:46:32 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:32 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:32 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info Jul 28 14:46:32 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:32 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e75daddd-0913-40e5-90b5-c7e908e216c0" returned: 0 in 0.343s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-e75daddd-0913-40e5-90b5-c7e908e216c0" released by "delete_volume" :: held 0.948s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:32 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info" returned: 0 in 0.310s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:32 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info is being set with open permissions: ugo+rw Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:32 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info Jul 28 14:46:32 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Flow 'volume_create_manager' (e4438c58-dc4e-448c-bdca-d1877d6188ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55cb3e4-ec3c-43f3-86f2-356c3de5f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55cb3e4-ec3c-43f3-86f2-356c3de5f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-471639226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2bcaa4-18a6-44b6-a7f9-45048ddcd059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bdc3ebaf4b47bfb9e2d330b3bca182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:32Z,use_quota=True,user_id='14e0ad58584745d5809801f398e21239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25262d38-d039-4930-a17b-979173d6d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25262d38-d039-4930-a17b-979173d6d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c73c972-d816-4f21-b2fe-c9be3469c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c73c972-d816-4f21-b2fe-c9be3469c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2bcaa4-18a6-44b6-a7f9-45048ddcd059', 'volume_name': 'volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d7366a-f389-45db-98de-f97ea14dbc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d7366a-f389-45db-98de-f97ea14dbc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb53c5-556c-4858-be71-64e99ac80b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:32 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Volume eb2bcaa4-18a6-44b6-a7f9-45048ddcd059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059', 'volume_size': 1} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Created reservations ['f1111e32-abde-4334-ac6e-0178eb60e08c', 'edefba78-813b-4a51-9472-672236ac353f', '03c1b35d-b2a9-467a-ab94-d79980297705', '65871846-b70c-49d4-ba8d-203cc6896d46'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:32 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.info" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:32 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:32 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-471639226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2bcaa4-18a6-44b6-a7f9-45048ddcd059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bdc3ebaf4b47bfb9e2d330b3bca182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:32Z,use_quota=True,user_id='14e0ad58584745d5809801f398e21239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Creating volume eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:32 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:32 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 1073741824 Jul 28 14:46:32 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1e8fbdfd-a6c2-4a39-a16e-a74f8770c1ef tempest-ProjectReaderTests-1572818496 None] Create snapshot completed successfully Jul 28 14:46:32 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.273s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Deleted volume successfully. Jul 28 14:46:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-21599e0d-1d92-4bb8-ac65-31c72807b5c5 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-e75daddd-0913-40e5-90b5-c7e908e216c0-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:33 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 1073741824" returned: 0 in 0.479s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:33 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:33 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:33 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.276s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb53c5-556c-4858-be71-64e99ac80b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e366077e-8dff-4577-963a-a011f8ef96dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-a4d60adc-85f4-4a24-b2aa-37644a6cd708-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Volume volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 (eb2bcaa4-18a6-44b6-a7f9-45048ddcd059): created successfully Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e366077e-8dff-4577-963a-a011f8ef96dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Flow 'volume_create_manager' (e4438c58-dc4e-448c-bdca-d1877d6188ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-a0a3d9c8-b018-4ca7-8589-834b2e50221b-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-a4d60adc-85f4-4a24-b2aa-37644a6cd708-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:33 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e4a0674f-8ece-4792-abf3-3759b5e0e1db tempest-VolumeDependencyTests-1036500764 None] Created volume successfully. Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-a0a3d9c8-b018-4ca7-8589-834b2e50221b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-a0a3d9c8-b018-4ca7-8589-834b2e50221b" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-quobyte-a4d60adc-85f4-4a24-b2aa-37644a6cd708" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-a0a3d9c8-b018-4ca7-8589-834b2e50221b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Deleting offline snapshot a0a3d9c8-b018-4ca7-8589-834b2e50221b of volume af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] snapshot_file for this snap is: volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-a4d60adc-85f4-4a24-b2aa-37644a6cd708" acquired by "delete_volume" :: waited 0.066s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c2859-8fa9-4658-8d79-7907a4a2ec40]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[900cc479-7213-4d69-9e8a-fc7a65fa3e71]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:33 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b Jul 28 14:46:33 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:33 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 Jul 28 14:46:33 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:34 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3311702-ecbb-4c28-93b5-467ffc6c55c7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:34 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:34 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708 Jul 28 14:46:34 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:34 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 Jul 28 14:46:34 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:34 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a4d60adc-85f4-4a24-b2aa-37644a6cd708" returned: 0 in 0.307s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-a4d60adc-85f4-4a24-b2aa-37644a6cd708" released by "delete_volume" :: held 0.799s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:34 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" returned: 0 in 0.407s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:34 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b Jul 28 14:46:34 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Created reservations ['587ddadd-f368-40c4-b2f0-449ad2fa345b', 'de4ff041-77f5-4d68-bbe7-b8e5abb6dfdb', 'ca081c5f-c306-4346-aa27-d336653df6f3', '8a3f3ace-1162-4bbd-906c-7dea7f198860'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Creating offline snapshot ed2f6f61-551e-49bd-88ce-1e9af34a1829 of volume eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0835b-44f1-4851-bb33-aee389a6292d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:34 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:34 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:34 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:34 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:35 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b" returned: 0 in 0.467s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:35 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b Jul 28 14:46:35 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:35 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.300s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Deleted volume successfully. Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ac654da8-eac0-4fea-bae3-181e754a3943 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-a4d60adc-85f4-4a24-b2aa-37644a6cd708-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.444s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:35 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 1G Jul 28 14:46:35 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:35 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2.a0a3d9c8-b018-4ca7-8589-834b2e50221b" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-a0a3d9c8-b018-4ca7-8589-834b2e50221b" released by "_delete_snapshot" :: held 1.675s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" released by "delete_snapshot" :: held 1.716s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Created reservations ['8a96ff52-6d2d-4006-a52e-efd008251c0b', 'c6de5019-dd6a-4e77-b4c1-7a3d5b1e3668', '53d7284b-66d1-4e6b-adab-f9cba968f165', '2343433c-1638-4a87-bff7-f17f29029524'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:35 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Delete snapshot completed successfully. Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a8cfa1e1-4542-427b-b221-7b4790f08524 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-a0a3d9c8-b018-4ca7-8589-834b2e50221b-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:35 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 1G" returned: 0 in 0.439s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:35 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:35 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-af5403ef-fb74-419f-a6f5-182a8f7e7cc2-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-af5403ef-fb74-419f-a6f5-182a8f7e7cc2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-7e07681c-7bf6-4b27-9f14-808c94ed14e4-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-7e07681c-7bf6-4b27-9f14-808c94ed14e4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:35 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4786707-ee3c-44f0-bf1b-6945fa11c85d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "cinder-quobyte-7e07681c-7bf6-4b27-9f14-808c94ed14e4" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 is being set with open permissions: ugo+rw Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-7e07681c-7bf6-4b27-9f14-808c94ed14e4" acquired by "delete_volume" :: waited 0.031s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:36 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:36 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a12178-0462-4edc-b18e-39471ffb4a47]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 Jul 28 14:46:36 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 Jul 28 14:46:36 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info Jul 28 14:46:36 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" returned: 0 in 0.430s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2 Jul 28 14:46:36 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4" returned: 0 in 0.428s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4 Jul 28 14:46:36 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info" returned: 0 in 0.321s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info is being set with open permissions: ugo+rw Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:36 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info Jul 28 14:46:36 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:36 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" returned: 0 in 0.309s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-af5403ef-fb74-419f-a6f5-182a8f7e7cc2" released by "delete_volume" :: held 0.827s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:36 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7e07681c-7bf6-4b27-9f14-808c94ed14e4" returned: 0 in 0.304s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Created reservations ['064d9c50-0974-493f-bc64-7931132e99b4', '3dadb513-ab94-4596-8a72-3a0bbc53659e', 'd6db6f36-b2af-4ea3-9d8b-f0c69536413e', '7b756e23-eaaa-4a2d-a186-2706956da5a3'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-quobyte-7e07681c-7bf6-4b27-9f14-808c94ed14e4" released by "delete_volume" :: held 0.797s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:36 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Created reservations ['5e740e25-50a8-421a-ba41-8ac6e623b277', 'c4c80fa1-97f8-4a7a-be0b-1eaa0f752ae4', 'c75557e5-02c8-4606-b636-33212789907e', '80cd9741-87da-489b-9737-40a004c2e33e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.info" returned: 0 in 0.326s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4b953b90-b4ba-466a-9c59-b18c663586c3 tempest-VolumeDependencyTests-1036500764 None] Create snapshot completed successfully Jul 28 14:46:37 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:37 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:37 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:37 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:37 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Deleted volume successfully. Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-69d58916-4753-4c17-860e-4c74b2fa4600 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-af5403ef-fb74-419f-a6f5-182a8f7e7cc2-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:37 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Deleted volume successfully. Jul 28 14:46:37 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-74eb3543-04e3-4087-83f6-42eeb8973c45 tempest-CreateVolumesFromImageTest-2093948105 None] Lock "cinder-7e07681c-7bf6-4b27-9f14-808c94ed14e4-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Flow 'volume_create_manager' (663ab29b-d898-4eb9-9796-e7c0fc7cd8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173dc1f-6c9a-4b2d-9d97-96a5d7b84375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9173dc1f-6c9a-4b2d-9d97-96a5d7b84375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1836088127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ec534b-75c3-44e9-8c49-076ef07e3c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60bdc3ebaf4b47bfb9e2d330b3bca182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed2f6f61-551e-49bd-88ce-1e9af34a1829,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:38Z,use_quota=True,user_id='14e0ad58584745d5809801f398e21239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524fe892-7084-46b5-b67c-90ce04df0247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524fe892-7084-46b5-b67c-90ce04df0247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdb0007-ce0e-4261-b91a-44b8a11b1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cdb0007-ce0e-4261-b91a-44b8a11b1988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0ec534b-75c3-44e9-8c49-076ef07e3c4a', 'volume_name': 'volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a', 'volume_size': 1, 'snapshot_id': 'ed2f6f61-551e-49bd-88ce-1e9af34a1829'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9a9b11-a4c4-4aa2-b33f-0e1cd72f9a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9a9b11-a4c4-4aa2-b33f-0e1cd72f9a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d86f08f-fb9f-4f83-9a30-07bdb3972205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Volume f0ec534b-75c3-44e9-8c49-076ef07e3c4a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a', 'volume_size': 1, 'snapshot_id': 'ed2f6f61-551e-49bd-88ce-1e9af34a1829'} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Creating volume f0ec534b-75c3-44e9-8c49-076ef07e3c4a from snapshot ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] snapshot: ed2f6f61-551e-49bd-88ce-1e9af34a1829, volume: f0ec534b-75c3-44e9-8c49-076ef07e3c4a, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d3a3c-552b-4f6e-a844-ab8932921e91]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a4b78c0e-dccb-4b48-b629-932c61bf4843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:38 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7229359-e61e-4e85-a489-b8ae1204407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7229359-e61e-4e85-a489-b8ae1204407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58020361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b446e569-0331-456b-9ada-68ac413b70de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:39Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e2e8f-b31d-4d97-93e1-1001a6371e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e2e8f-b31d-4d97-93e1-1001a6371e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e810d91-b942-46aa-83b3-25856512de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e810d91-b942-46aa-83b3-25856512de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b446e569-0331-456b-9ada-68ac413b70de', 'volume_name': 'volume-b446e569-0331-456b-9ada-68ac413b70de', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75156ea8-bbdf-4f1c-8534-bdac97904439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75156ea8-bbdf-4f1c-8534-bdac97904439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66704c5a-f56a-4e65-8476-81125a22e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:38 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Volume b446e569-0331-456b-9ada-68ac413b70de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b446e569-0331-456b-9ada-68ac413b70de', 'volume_size': 1} Jul 28 14:46:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:39 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1aed9-c23a-406a-9483-30fc40ad2b7a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:39 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:39 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:39 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:46:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:39 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a Jul 28 14:46:39 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:44 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" returned: 0 in 4.843s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e30da7-a6e4-40ac-ae7f-b92726983069]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:44 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:44 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:45 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.539s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:46:45 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Converted 1024.00 MB image at 211.38 MB/s Jul 28 14:46:45 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a is being set with open permissions: ugo+rw Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:45 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a Jul 28 14:46:45 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:45 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" released by "_copy_volume_from_snapshot" :: held 6.639s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" released by "_create_volume_from_snapshot" :: held 6.699s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.730s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.349s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58020361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b446e569-0331-456b-9ada-68ac413b70de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:39Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Creating volume b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:45 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:45 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de 1073741824 Jul 28 14:46:45 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d86f08f-fb9f-4f83-9a30-07bdb3972205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a', 'volume_size': 1, 'snapshot_id': 'ed2f6f61-551e-49bd-88ce-1e9af34a1829'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a229b4-96f5-4090-b63d-bc26ee143e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:45 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Volume volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a (f0ec534b-75c3-44e9-8c49-076ef07e3c4a): created successfully Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a229b4-96f5-4090-b63d-bc26ee143e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Flow 'volume_create_manager' (663ab29b-d898-4eb9-9796-e7c0fc7cd8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-ce1e1c9a-6fdd-47b2-80ed-5873bfc997da tempest-VolumeDependencyTests-1036500764 None] Created volume successfully. Jul 28 14:46:45 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de 1073741824" returned: 0 in 0.475s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:45 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de Jul 28 14:46:45 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:46 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66704c5a-f56a-4e65-8476-81125a22e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b446e569-0331-456b-9ada-68ac413b70de', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2a5c24-4593-47e3-8986-34bade01e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Volume volume-b446e569-0331-456b-9ada-68ac413b70de (b446e569-0331-456b-9ada-68ac413b70de): created successfully Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2a5c24-4593-47e3-8986-34bade01e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a4b78c0e-dccb-4b48-b629-932c61bf4843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-ed2f6f61-551e-49bd-88ce-1e9af34a1829-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-061bba4d-f7a6-4eff-8f37-22112ae0ce62 tempest-ProjectReaderTests-1572818496 None] Created volume successfully. Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-ed2f6f61-551e-49bd-88ce-1e9af34a1829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Deleting offline snapshot ed2f6f61-551e-49bd-88ce-1e9af34a1829 of volume eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] snapshot_file for this snap is: volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af682ff-d251-42f4-b9b1-ffa71c104746]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:46 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:46 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:46 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.384s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d7cd0-9635-47e2-a327-52db1f349c7f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Creating offline snapshot e2770dcd-9355-4ed1-8ba2-56d91ecb33ed of volume b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aebdc60-c303-4f56-ab21-f7f7a0b48a35]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:46 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:46 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:46 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de Jul 28 14:46:46 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:47 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.419s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:47 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:47 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:47 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de" returned: 0 in 0.419s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:47 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed 1G Jul 28 14:46:47 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:47 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:47 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829 Jul 28 14:46:47 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:47 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed 1G" returned: 0 in 0.457s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b446e569-0331-456b-9ada-68ac413b70de -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:47 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b446e569-0331-456b-9ada-68ac413b70de -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed Jul 28 14:46:47 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:47 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059.ed2f6f61-551e-49bd-88ce-1e9af34a1829" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-ed2f6f61-551e-49bd-88ce-1e9af34a1829" released by "_delete_snapshot" :: held 1.604s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" released by "delete_snapshot" :: held 1.635s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Created reservations ['9506a30e-5132-42f7-9176-6a5057dade6c', 'e69f0a4f-2950-45b7-bd52-0bdb0cb3416e', '084d4482-ceec-4295-8387-0d37b8f67bd4', '3c88c9a0-2876-4b4d-9055-ce5a2abba846'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Delete snapshot completed successfully. Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f3f5db18-e753-43e0-87b4-65bf99b70612 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-ed2f6f61-551e-49bd-88ce-1e9af34a1829-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:47 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b446e569-0331-456b-9ada-68ac413b70de -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" returned: 0 in 0.355s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:47 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed is being set with open permissions: ugo+rw Jul 28 14:46:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:48 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed Jul 28 14:46:48 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:48 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:48 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info Jul 28 14:46:48 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b031f-277a-413c-bdac-6df34106a123]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:48 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:48 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info is being set with open permissions: ugo+rw Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:48 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info Jul 28 14:46:48 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:48 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:48 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:48 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:48 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.435s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.info" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:48 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059 Jul 28 14:46:48 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e53e5119-1d41-4499-8b9c-e0f1ae952f74 tempest-ProjectReaderTests-1572818496 None] Create snapshot completed successfully Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:49 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" returned: 0 in 0.300s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:49 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059" released by "delete_volume" :: held 0.803s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:49 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Created reservations ['2b35d24b-cd4d-4fc8-8141-dd15e158898a', '14d0cb6e-2dec-4b41-9964-0e13663c30f6', 'b633d4c4-2385-4cd0-baea-9ee1dee3a4c7', '0e062c3b-add7-4bcd-b2ac-982b9a8a3346'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:49 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:49 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:49 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-f0ec534b-75c3-44e9-8c49-076ef07e3c4a-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-f0ec534b-75c3-44e9-8c49-076ef07e3c4a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d144af-7287-4fd9-bd1b-d3c0c72f8b2d]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:49 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.301s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Deleted volume successfully. Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0b28034f-ab2b-4f06-a6e7-7ca3ac88f137 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-eb2bcaa4-18a6-44b6-a7f9-45048ddcd059-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:49 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a Jul 28 14:46:49 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Deleting offline snapshot e2770dcd-9355-4ed1-8ba2-56d91ecb33ed of volume b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:46:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] snapshot_file for this snap is: volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a60e5-8e2f-40b2-b2a3-7d6193c9b58b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:50 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:50 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a Jul 28 14:46:50 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:50 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed Jul 28 14:46:50 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:50 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-quobyte-f0ec534b-75c3-44e9-8c49-076ef07e3c4a" released by "delete_volume" :: held 0.781s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:50 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" returned: 0 in 0.415s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b446e569-0331-456b-9ada-68ac413b70de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8c37d-55f1-4830-91e4-b50e14935317]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Created reservations ['9cd4aded-c7bd-4a40-8243-adf5d34a65dc', '0bc7b9e6-b2a9-4d53-90dd-7a949a5d85d3', 'da54c7bd-df14-433b-a4d2-f2fe344cd07e', 'a9ee84ea-a7ab-4ed7-8d69-566f3203b44d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:50 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de Jul 28 14:46:50 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:50 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:50 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:50 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.320s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:50 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Deleted volume successfully. Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-65ac9b9f-7d35-4ed4-a847-907fe8fe6c41 tempest-VolumeDependencyTests-1036500764 None] Lock "cinder-f0ec534b-75c3-44e9-8c49-076ef07e3c4a-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:50 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de" returned: 0 in 0.507s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:50 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed Jul 28 14:46:50 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:51 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" returned: 0 in 0.352s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:51 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed Jul 28 14:46:51 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:51 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de.e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" returned: 0 in 0.272s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed" released by "_delete_snapshot" :: held 1.669s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" released by "delete_snapshot" :: held 1.696s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Created reservations ['2d373c1e-ec2f-4436-b320-6db3d2ac2149', '1096461e-725d-4258-a66f-4cef10d58b96', '028de491-506c-414d-a208-fe9f8f3f7cfe', '802be925-8ec3-4b65-b376-c72903c25c72'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Delete snapshot completed successfully. Jul 28 14:46:51 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e66bd8a2-dea1-491a-9a91-2573d103dc39 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-e2770dcd-9355-4ed1-8ba2-56d91ecb33ed-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-b446e569-0331-456b-9ada-68ac413b70de-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-b446e569-0331-456b-9ada-68ac413b70de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8567ab-0321-4b70-a05d-31732a7ff104]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:52 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de Jul 28 14:46:52 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:52 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:52 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de Jul 28 14:46:52 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:52 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-b446e569-0331-456b-9ada-68ac413b70de" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b446e569-0331-456b-9ada-68ac413b70de" released by "delete_volume" :: held 0.735s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:52 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Created reservations ['62a4d5a7-92a4-4c1b-a6ea-5869df952245', '74aa1040-4397-47c4-982c-53db8a2913b3', '4ea4063d-c3ac-4804-8977-ba9aa69e6d7e', '28a487b6-3cb9-4c1b-8cb4-c8b07e8be814'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:53 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:46:53 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:53 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.273s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:46:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Deleted volume successfully. Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-c2e0e330-7f7b-45c5-bc58-916979ca6849 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-b446e569-0331-456b-9ada-68ac413b70de-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (9dded70c-b402-4ea5-b087-85603557c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388b0cef-f095-473c-a875-06e54439bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388b0cef-f095-473c-a875-06e54439bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786136913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:54Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcb8efb-eda0-4006-902e-f6086b71fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcb8efb-eda0-4006-902e-f6086b71fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3b9d6-4459-4f35-b998-7fdd7f7498ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec3b9d6-4459-4f35-b998-7fdd7f7498ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc', 'volume_name': 'volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a14f98-a11d-4c7d-a1a7-1b9c3a8a9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a14f98-a11d-4c7d-a1a7-1b9c3a8a9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b94432c-9160-4292-98ad-35a0c9a14aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Volume f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc', 'volume_size': 1} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1786136913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:54Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Creating volume f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:54 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc 1073741824 Jul 28 14:46:54 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=194,cinder:UPDATE=288,cinder:DELETE=28,cinder:INSERT=75 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=219,cinder:UPDATE=280,cinder:INSERT=78,cinder:DELETE=22 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Flow 'volume_create_manager' (28ca1d83-640c-4531-bb7a-7eb4fd9a4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74e4328-5d85-4609-8994-f120944d7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74e4328-5d85-4609-8994-f120944d7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8004411d-594f-49c2-8e37-9f39425a4679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440e819b2ff94e9b97c7a1f90b8e88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:54Z,use_quota=True,user_id='2c7d1b7f0b86466aa8d0aa2ff45b6b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9e1380-1ab9-4b87-a264-d4288e8fe763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9e1380-1ab9-4b87-a264-d4288e8fe763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e0c1f1-a9fe-499a-889d-4caef6bbff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e0c1f1-a9fe-499a-889d-4caef6bbff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8004411d-594f-49c2-8e37-9f39425a4679', 'volume_name': 'volume-8004411d-594f-49c2-8e37-9f39425a4679', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1dbf7a-9c48-4cd8-b0a9-027d1797b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1dbf7a-9c48-4cd8-b0a9-027d1797b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017c0638-b282-482f-8b5c-b4b0dad48d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Volume 8004411d-594f-49c2-8e37-9f39425a4679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8004411d-594f-49c2-8e37-9f39425a4679', 'volume_size': 1} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:54 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc 1073741824" returned: 0 in 0.497s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:54 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc Jul 28 14:46:54 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:54 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8004411d-594f-49c2-8e37-9f39425a4679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440e819b2ff94e9b97c7a1f90b8e88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:54Z,use_quota=True,user_id='2c7d1b7f0b86466aa8d0aa2ff45b6b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Creating volume 8004411d-594f-49c2-8e37-9f39425a4679 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b94432c-9160-4292-98ad-35a0c9a14aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 1073741824 Jul 28 14:46:54 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0bc834-c1f7-44c9-84f3-2b204e357b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Volume volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc (f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc): created successfully Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0bc834-c1f7-44c9-84f3-2b204e357b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (9dded70c-b402-4ea5-b087-85603557c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b24ceb19-92be-480d-bb8e-b86c21844776 tempest-ProjectReaderTests-1572818496 None] Created volume successfully. Jul 28 14:46:55 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 1073741824" returned: 0 in 0.547s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:55 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 Jul 28 14:46:55 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:55 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679" returned: 0 in 0.332s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017c0638-b282-482f-8b5c-b4b0dad48d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8004411d-594f-49c2-8e37-9f39425a4679', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9131cd-15f6-4eb9-9b59-ff1946ec522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:55 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Volume volume-8004411d-594f-49c2-8e37-9f39425a4679 (8004411d-594f-49c2-8e37-9f39425a4679): created successfully Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9131cd-15f6-4eb9-9b59-ff1946ec522b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:55 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Flow 'volume_create_manager' (28ca1d83-640c-4531-bb7a-7eb4fd9a4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:55 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-38646f0c-9844-4a28-bbe8-5fe8d3d3987b tempest-CinderUnicodeTest-179099953 None] Created volume successfully. Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Creating offline snapshot 4eaa1754-8035-435c-92b3-36c404ca0f56 of volume f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded5d54-3fcd-42f2-8aa1-443cc49b86a9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:56 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc Jul 28 14:46:56 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:56 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" returned: 0 in 0.550s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:56 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 1G Jul 28 14:46:56 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Flow 'volume_create_manager' (61c8c6b6-5576-4144-a66a-bfa08c4db59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7b342-0e21-4541-a7a5-d2784e5b4cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a7b342-0e21-4541-a7a5-d2784e5b4cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1389818586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a9141b-14a0-4530-8228-2bf4c23c9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440e819b2ff94e9b97c7a1f90b8e88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:57Z,use_quota=True,user_id='2c7d1b7f0b86466aa8d0aa2ff45b6b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a2f140-b2d0-4998-b38a-0aae03c0f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a2f140-b2d0-4998-b38a-0aae03c0f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa45f8-e59b-4a22-9e18-73b89fff3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa45f8-e59b-4a22-9e18-73b89fff3a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a9141b-14a0-4530-8228-2bf4c23c9368', 'volume_name': 'volume-d7a9141b-14a0-4530-8228-2bf4c23c9368', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b229bdd-135f-4e56-acd5-84a1e4f6331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b229bdd-135f-4e56-acd5-84a1e4f6331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49441e14-bb81-4ffe-97ba-bc0f4c4dac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Volume d7a9141b-14a0-4530-8228-2bf4c23c9368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a9141b-14a0-4530-8228-2bf4c23c9368', 'volume_size': 1} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:57 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 1G" returned: 0 in 0.640s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:57 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 Jul 28 14:46:57 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:57 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:57 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 is being set with open permissions: ugo+rw Jul 28 14:46:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:57 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 Jul 28 14:46:57 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:58 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:58 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info Jul 28 14:46:58 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:58 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:58 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info is being set with open permissions: ugo+rw Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:58 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info Jul 28 14:46:58 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:58 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.info" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:46:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1389818586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a9141b-14a0-4530-8228-2bf4c23c9368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440e819b2ff94e9b97c7a1f90b8e88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:46:57Z,use_quota=True,user_id='2c7d1b7f0b86466aa8d0aa2ff45b6b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Creating volume d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:46:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:46:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:58 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 1073741824 Jul 28 14:46:58 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-dce2c58f-c236-4efc-9045-f311152e2c07 tempest-ProjectReaderTests-1572818496 None] Create snapshot completed successfully Jul 28 14:46:59 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 1073741824" returned: 0 in 0.530s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:59 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 Jul 28 14:46:59 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-4eaa1754-8035-435c-92b3-36c404ca0f56-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-4eaa1754-8035-435c-92b3-36c404ca0f56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-4eaa1754-8035-435c-92b3-36c404ca0f56" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:46:59 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368" returned: 0 in 0.302s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-4eaa1754-8035-435c-92b3-36c404ca0f56" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Deleting offline snapshot 4eaa1754-8035-435c-92b3-36c404ca0f56 of volume f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] snapshot_file for this snap is: volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49441e14-bb81-4ffe-97ba-bc0f4c4dac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a9141b-14a0-4530-8228-2bf4c23c9368', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d306dd5-810a-42df-9eb5-4c02ac989677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e334e83-c56c-4b13-8d6d-24f9673fa0bb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:46:59 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Volume volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 (d7a9141b-14a0-4530-8228-2bf4c23c9368): created successfully Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d306dd5-810a-42df-9eb5-4c02ac989677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Flow 'volume_create_manager' (61c8c6b6-5576-4144-a66a-bfa08c4db59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:46:59 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-63694e17-b69b-4c76-8989-38fdaa946e34 tempest-CinderUnicodeTest-179099953 None] Created volume successfully. Jul 28 14:46:59 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 Jul 28 14:46:59 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:46:59 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56" returned: 0 in 0.384s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b2005-320b-4a4c-bec8-729c11232ac0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:46:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:00 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc Jul 28 14:47:00 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:00 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:00 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 Jul 28 14:47:00 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Creating offline snapshot 0eb027a4-34c8-4a2a-b116-44fc69aa4170 of volume d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0759307-11fb-4b48-a1ae-c52a179c40de]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:00 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 Jul 28 14:47:00 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:00 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56" returned: 0 in 0.402s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:00 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56 Jul 28 14:47:00 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:00 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368" returned: 0 in 0.397s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:00 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 1G Jul 28 14:47:00 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:00 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc.4eaa1754-8035-435c-92b3-36c404ca0f56" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-4eaa1754-8035-435c-92b3-36c404ca0f56" released by "_delete_snapshot" :: held 1.566s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" released by "delete_snapshot" :: held 1.594s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Created reservations ['fa75853d-0a17-4250-ac03-b829779e11c5', 'a835ebdb-df92-42e2-9ec9-6d07cdcde306', '9b78cbc4-e77c-454d-bb09-eae6abaacf87', '67f49ece-5fcf-4578-8f02-399f57c61cc0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Delete snapshot completed successfully. Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e197b228-0284-42d3-86a6-26e6de47278f tempest-ProjectReaderTests-1572818496 None] Lock "cinder-4eaa1754-8035-435c-92b3-36c404ca0f56-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:01 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 1G" returned: 0 in 0.419s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:01 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 Jul 28 14:47:01 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:01 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:01 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 is being set with open permissions: ugo+rw Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17dd604-9764-44ef-801d-9e0ac1e9dfae]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:01 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 Jul 28 14:47:01 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:01 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc Jul 28 14:47:01 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:01 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170" returned: 0 in 0.273s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:02 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info Jul 28 14:47:02 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:02 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" returned: 0 in 0.418s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:02 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc Jul 28 14:47:02 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:02 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info is being set with open permissions: ugo+rw Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:02 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info Jul 28 14:47:02 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:02 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc" released by "delete_volume" :: held 0.749s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Created reservations ['47dfc631-d12c-4f73-81c8-be5695455f27', '72e87dfe-a83b-40f3-ad4d-711cd8866c0a', 'dfece6e0-d34d-4c94-846e-40396886af4d', 'f1b24a24-1c81-4749-8765-2f4a10b558ec'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:02 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.info" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:02 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3d22eb56-f0cd-4b6b-93f5-b4a34408d3cd tempest-CinderUnicodeTest-179099953 None] Create snapshot completed successfully Jul 28 14:47:02 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:02 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Deleted volume successfully. Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db018b2b-370c-4c06-b338-73442b48b887 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-f1a5f751-a6d0-4c57-94a3-f7e2dddf85dc-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (1707bf95-b750-4a0a-ba39-6acc5c041dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abdae1f-b383-4fe2-b256-772b8bc024c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abdae1f-b383-4fe2-b256-772b8bc024c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122683326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199f4662-5304-4d56-a3a3-d7d313e54f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:03Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5ec28-e17b-4d4b-a071-cecf16993ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f5ec28-e17b-4d4b-a071-cecf16993ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f10279-e7b5-46de-8392-e82d4ccdb0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f10279-e7b5-46de-8392-e82d4ccdb0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199f4662-5304-4d56-a3a3-d7d313e54f97', 'volume_name': 'volume-199f4662-5304-4d56-a3a3-d7d313e54f97', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632d299-7353-4267-adc1-a4ddd9ec9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632d299-7353-4267-adc1-a4ddd9ec9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9936f93d-5cbe-4d6b-bf48-7ca67a4f7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:03 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Volume 199f4662-5304-4d56-a3a3-d7d313e54f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199f4662-5304-4d56-a3a3-d7d313e54f97', 'volume_size': 1} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122683326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199f4662-5304-4d56-a3a3-d7d313e54f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:03Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Creating volume 199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:03 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:03 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 1073741824 Jul 28 14:47:03 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-0eb027a4-34c8-4a2a-b116-44fc69aa4170-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-0eb027a4-34c8-4a2a-b116-44fc69aa4170-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-quobyte-0eb027a4-34c8-4a2a-b116-44fc69aa4170" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-0eb027a4-34c8-4a2a-b116-44fc69aa4170" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Deleting offline snapshot 0eb027a4-34c8-4a2a-b116-44fc69aa4170 of volume d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] snapshot_file for this snap is: volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c24e2-ffa9-4757-9ec2-2b89c8d72c7c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:03 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 Jul 28 14:47:03 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:03 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 1073741824" returned: 0 in 0.544s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:04 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 Jul 28 14:47:04 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:04 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170" returned: 0 in 0.413s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a9141b-14a0-4530-8228-2bf4c23c9368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b36143-9cf9-49a2-942d-ae94fa6e2513]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:04 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97" returned: 0 in 0.334s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9936f93d-5cbe-4d6b-bf48-7ca67a4f7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199f4662-5304-4d56-a3a3-d7d313e54f97', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360bb61-84d5-45b2-b1d2-8b286d8d03cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:04 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 Jul 28 14:47:04 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Volume volume-199f4662-5304-4d56-a3a3-d7d313e54f97 (199f4662-5304-4d56-a3a3-d7d313e54f97): created successfully Jul 28 14:47:04 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360bb61-84d5-45b2-b1d2-8b286d8d03cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (1707bf95-b750-4a0a-ba39-6acc5c041dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d619437a-8af7-4e17-b3ad-854926f6cd2c tempest-ProjectReaderTests-1572818496 None] Created volume successfully. Jul 28 14:47:04 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368" returned: 0 in 0.475s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:04 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 Jul 28 14:47:04 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:05 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:05 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170 Jul 28 14:47:05 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:05 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368.0eb027a4-34c8-4a2a-b116-44fc69aa4170" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-0eb027a4-34c8-4a2a-b116-44fc69aa4170" released by "_delete_snapshot" :: held 1.721s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" released by "delete_snapshot" :: held 1.757s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Created reservations ['8500f062-6276-4ae5-a564-bd4c468b1cf7', '1fa18de3-f7ea-43dd-bc24-b3d6594cfd39', 'eccd44dc-e19e-42c9-9076-1dcd8914e62d', '8f70349f-cd88-4547-87c9-58ae05795591'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Delete snapshot completed successfully. Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Creating offline snapshot cc408e47-8f14-4d18-9f5f-55f86c749b1c of volume 199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-d068887b-c0cf-4ee3-83e5-88e3bc2b7a24 tempest-CinderUnicodeTest-179099953 None] Lock "cinder-0eb027a4-34c8-4a2a-b116-44fc69aa4170-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf7dd3-179d-4e9c-8f17-ca494cdf0a55]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:05 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 Jul 28 14:47:05 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-d7a9141b-14a0-4530-8228-2bf4c23c9368-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "cinder-d7a9141b-14a0-4530-8228-2bf4c23c9368-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:05 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27720a-e1a2-4ace-b103-148703379a2f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c 1G Jul 28 14:47:06 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:06 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 Jul 28 14:47:06 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:06 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368" returned: 0 in 0.385s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368 Jul 28 14:47:06 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:06 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c 1G" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199f4662-5304-4d56-a3a3-d7d313e54f97 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199f4662-5304-4d56-a3a3-d7d313e54f97 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c Jul 28 14:47:06 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:06 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d7a9141b-14a0-4530-8228-2bf4c23c9368" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-d7a9141b-14a0-4530-8228-2bf4c23c9368" released by "delete_volume" :: held 0.737s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Created reservations ['e48bd408-9b44-4072-aada-38fa889edad1', '3c051a27-8b81-4753-886e-9ab16b976634', '33540f49-7813-4a00-82cd-e5d78386cbb6', 'ad0da7c7-fea4-427c-b2c0-548d94ff0f08'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:06 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:06 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-199f4662-5304-4d56-a3a3-d7d313e54f97 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c" returned: 0 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:06 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c is being set with open permissions: ugo+rw Jul 28 14:47:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:06 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c Jul 28 14:47:06 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-8004411d-594f-49c2-8e37-9f39425a4679-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:07 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "cinder-8004411d-594f-49c2-8e37-9f39425a4679-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.370s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Deleted volume successfully. Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-684eb75a-0655-4986-9841-99ff5f6efaaa tempest-CinderUnicodeTest-179099953 None] Lock "cinder-d7a9141b-14a0-4530-8228-2bf4c23c9368-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Acquiring lock "cinder-quobyte-8004411d-594f-49c2-8e37-9f39425a4679" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-8004411d-594f-49c2-8e37-9f39425a4679" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[0205b17c-66f4-4b96-8850-ee779663d328]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:07 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c" returned: 0 in 0.441s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:07 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info Jul 28 14:47:07 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:07 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 Jul 28 14:47:07 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:07 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:07 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info is being set with open permissions: ugo+rw Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:07 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info Jul 28 14:47:07 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:07 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679" returned: 0 in 0.462s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:07 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679 Jul 28 14:47:07 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:07 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.info" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-72e7401c-fa89-4027-b1bf-146c6484b0b9 tempest-ProjectReaderTests-1572818496 None] Create snapshot completed successfully Jul 28 14:47:08 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8004411d-594f-49c2-8e37-9f39425a4679" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "cinder-quobyte-8004411d-594f-49c2-8e37-9f39425a4679" released by "delete_volume" :: held 0.798s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Created reservations ['469545b6-64ff-46a7-a9fb-c2d93a836264', '19844dd8-2b0f-48ba-b5f6-2d01b3560cf3', 'baed3e5e-7575-4441-a7b8-6b19a8513452', 'eeeae2bc-c2c6-4d76-8194-0058fa1b1f65'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:08 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:08 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:08 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.271s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:08 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Deleted volume successfully. Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-bd3d50e1-a941-4538-9337-3cb10b65294e tempest-CinderUnicodeTest-179099953 None] Lock "cinder-8004411d-594f-49c2-8e37-9f39425a4679-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Flow 'volume_create_manager' (7510f32a-d316-475e-a366-a29768936463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd5fb8b-307e-4116-86aa-c5dc79a84a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd5fb8b-307e-4116-86aa-c5dc79a84a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-958587221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e639bb0f-cd13-4771-9ecc-87ef37e9f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c24b5ae584140adabe938ae033a7ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:09Z,use_quota=True,user_id='cda68ee5c3b64f089abc6f03c4d73dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ae0482-79c4-437f-acae-f7c64e4cef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ae0482-79c4-437f-acae-f7c64e4cef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de62a22-eedb-4add-bcbf-e368ac2c8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de62a22-eedb-4add-bcbf-e368ac2c8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e639bb0f-cd13-4771-9ecc-87ef37e9f927', 'volume_name': 'volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccce8acb-5d79-45cb-a7f9-1596de743c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccce8acb-5d79-45cb-a7f9-1596de743c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84e2313-98c4-413b-a32d-e6f616fe5c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:08 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Volume e639bb0f-cd13-4771-9ecc-87ef37e9f927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927', 'volume_size': 1} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-958587221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e639bb0f-cd13-4771-9ecc-87ef37e9f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c24b5ae584140adabe938ae033a7ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:09Z,use_quota=True,user_id='cda68ee5c3b64f089abc6f03c4d73dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Creating volume e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:08 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:08 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 1073741824 Jul 28 14:47:08 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-cc408e47-8f14-4d18-9f5f-55f86c749b1c-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-cc408e47-8f14-4d18-9f5f-55f86c749b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-cc408e47-8f14-4d18-9f5f-55f86c749b1c" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-cc408e47-8f14-4d18-9f5f-55f86c749b1c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Deleting offline snapshot cc408e47-8f14-4d18-9f5f-55f86c749b1c of volume 199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:08 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] snapshot_file for this snap is: volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca6276e-fb47-4e40-a319-af4d2c8af2a2]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:09 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c Jul 28 14:47:09 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:09 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 1073741824" returned: 0 in 0.561s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:09 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:09 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:09 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c" returned: 0 in 0.469s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-199f4662-5304-4d56-a3a3-d7d313e54f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[689a04ac-8dff-45c5-a910-8764e3ea8552]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:09 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84e2313-98c4-413b-a32d-e6f616fe5c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c701dcc-2b20-4a1d-a529-6c81a008bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:09 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Volume volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 (e639bb0f-cd13-4771-9ecc-87ef37e9f927): created successfully Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c701dcc-2b20-4a1d-a529-6c81a008bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Flow 'volume_create_manager' (7510f32a-d316-475e-a366-a29768936463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:09 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 Jul 28 14:47:09 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e38c64cc-b262-489d-b947-2f573dd1a6c9 tempest-SnapshotDependencyTests-2047842675 None] Created volume successfully. Jul 28 14:47:09 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97" returned: 0 in 0.432s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:09 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c Jul 28 14:47:09 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:10 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c" returned: 0 in 0.338s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:10 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c Jul 28 14:47:10 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:10 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97.cc408e47-8f14-4d18-9f5f-55f86c749b1c" returned: 0 in 0.255s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-cc408e47-8f14-4d18-9f5f-55f86c749b1c" released by "_delete_snapshot" :: held 1.638s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" released by "delete_snapshot" :: held 1.673s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Created reservations ['b60a3489-90f3-4a64-a1cd-72bc3a30c1d8', '07c7f13b-306a-4bef-8329-d0dac1ad6525', 'b1a867ae-f30f-48df-8b34-f20d340c4d61', 'cb6a8a46-fb8a-42df-a175-64f6bc278fbd'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Delete snapshot completed successfully. Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-60c3e1b9-0495-421a-9bfa-656a40610bf3 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-cc408e47-8f14-4d18-9f5f-55f86c749b1c-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Creating offline snapshot d6590dea-2d4e-4404-879e-64d8ec1f980d of volume e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426c7d8-c8fa-43e0-8490-f6eebbed5114]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-199f4662-5304-4d56-a3a3-d7d313e54f97-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "cinder-199f4662-5304-4d56-a3a3-d7d313e54f97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:11 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:11 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[83000728-5317-408f-a2da-cf2b397adbb0]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:11 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 Jul 28 14:47:11 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:11 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.403s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:11 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d 1G Jul 28 14:47:11 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:11 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:11 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97 Jul 28 14:47:11 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:11 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-199f4662-5304-4d56-a3a3-d7d313e54f97" returned: 0 in 0.313s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:11 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-199f4662-5304-4d56-a3a3-d7d313e54f97" released by "delete_volume" :: held 0.757s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d 1G" returned: 0 in 0.492s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:11 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:11 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:11 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Created reservations ['20f834c5-44ed-44b5-9466-8d7099bec8e1', 'd74b9c6a-ba29-4e6f-8045-3207dbe93caa', '333c6f91-e105-47e1-b1b2-580f4d99610d', '6396aa9d-f135-4503-883f-cdea4ee3e7e7'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:12 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:12 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:12 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (e6ff71d8-3c5f-42b2-936a-6489d64ecf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e939353b-7e78-4eaf-9fb0-543ee4d45274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.377s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:12 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d is being set with open permissions: ugo+rw Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e939353b-7e78-4eaf-9fb0-543ee4d45274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716743905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eba454f-e0d1-4ca3-a655-d3601d3eb5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:12Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6427b643-4527-4795-aa3a-ed4d4d87e38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:12 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6427b643-4527-4795-aa3a-ed4d4d87e38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43a6788-a3d6-40fd-9063-5cb7dec4f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43a6788-a3d6-40fd-9063-5cb7dec4f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eba454f-e0d1-4ca3-a655-d3601d3eb5d5', 'volume_name': 'volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ab892-7666-404c-9ccf-8e6532539fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ab892-7666-404c-9ccf-8e6532539fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a825763-aabc-4216-9a3c-fc63638d0099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Volume 2eba454f-e0d1-4ca3-a655-d3601d3eb5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5', 'volume_size': 1} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:12 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Deleted volume successfully. Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-446f3581-7904-492b-b978-264b3b19fbeb tempest-ProjectReaderTests-1572818496 None] Lock "cinder-199f4662-5304-4d56-a3a3-d7d313e54f97-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:12 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:12 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info Jul 28 14:47:12 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a563503b-26d4-4fa6-9705-ae95cc7dff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f437186-ded1-46c0-9904-60a60aa508ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f437186-ded1-46c0-9904-60a60aa508ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1087417173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbca5db-08e5-4c54-a02e-23bd3048c748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:13Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb606fb4-501e-4e2d-9cc7-baf6987a86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb606fb4-501e-4e2d-9cc7-baf6987a86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f09862d-943c-4597-8f48-c347bbe5b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f09862d-943c-4597-8f48-c347bbe5b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfbca5db-08e5-4c54-a02e-23bd3048c748', 'volume_name': 'volume-bfbca5db-08e5-4c54-a02e-23bd3048c748', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313e3ec3-0611-4fda-af39-8d3aff083a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313e3ec3-0611-4fda-af39-8d3aff083a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6107d1f-90fd-46d9-98ed-f423a06678ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:12 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Volume bfbca5db-08e5-4c54-a02e-23bd3048c748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfbca5db-08e5-4c54-a02e-23bd3048c748', 'volume_size': 1} Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:12 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:12 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info is being set with open permissions: ugo+rw Jul 28 14:47:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:12 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info Jul 28 14:47:12 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:13 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.info" returned: 0 in 0.232s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716743905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eba454f-e0d1-4ca3-a655-d3601d3eb5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:12Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Creating volume 2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:13 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:13 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 1073741824 Jul 28 14:47:13 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-d2423617-ce98-4890-b816-8018e5a6f4a5 tempest-SnapshotDependencyTests-2047842675 None] Create snapshot completed successfully Jul 28 14:47:13 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 1073741824" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:13 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 Jul 28 14:47:13 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:13 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" returned: 0 in 0.257s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1087417173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbca5db-08e5-4c54-a02e-23bd3048c748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9f07b78a3264611968b8d7c546307cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:13Z,use_quota=True,user_id='60c0ee062dbd4eb0a1498833bfe505bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Creating volume bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:13 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:13 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 1073741824 Jul 28 14:47:13 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a825763-aabc-4216-9a3c-fc63638d0099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ace31-7946-4f66-b10f-7cb06c1bf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Volume volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 (2eba454f-e0d1-4ca3-a655-d3601d3eb5d5): created successfully Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ace31-7946-4f66-b10f-7cb06c1bf8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (e6ff71d8-3c5f-42b2-936a-6489d64ecf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:13 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-454c161e-a335-44d3-b02f-311a75817139 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:14 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 1073741824" returned: 0 in 0.477s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:14 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 Jul 28 14:47:14 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:14 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6107d1f-90fd-46d9-98ed-f423a06678ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbca5db-08e5-4c54-a02e-23bd3048c748', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca13d27-b490-438e-80e7-a0a21f27f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Volume volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 (bfbca5db-08e5-4c54-a02e-23bd3048c748): created successfully Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca13d27-b490-438e-80e7-a0a21f27f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Flow 'volume_create_manager' (a563503b-26d4-4fa6-9705-ae95cc7dff2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:14 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-5cd99500-244f-4665-b369-b905a6639f6c tempest-ProjectReaderTests-1572818496 None] Created volume successfully. Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot a6fded97-4888-4bba-96bc-2c2a7b912098 of volume 2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Flow 'volume_create_manager' (9b72f71a-002c-4858-b1e4-29de473f6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf657e04-3fa0-4502-b1bc-c5dbb08ba6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcedd736-53dd-4678-b2be-012b4fff1c6a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf657e04-3fa0-4502-b1bc-c5dbb08ba6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0595d4-2cfa-492c-be9a-eaf380378a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c24b5ae584140adabe938ae033a7ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6590dea-2d4e-4404-879e-64d8ec1f980d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:15Z,use_quota=True,user_id='cda68ee5c3b64f089abc6f03c4d73dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b4235-7d27-45b2-b63e-317304f26fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b4235-7d27-45b2-b63e-317304f26fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c85c17f-d6c9-4120-876d-646408eef9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c85c17f-d6c9-4120-876d-646408eef9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d0595d4-2cfa-492c-be9a-eaf380378a89', 'volume_name': 'volume-7d0595d4-2cfa-492c-be9a-eaf380378a89', 'volume_size': 1, 'snapshot_id': 'd6590dea-2d4e-4404-879e-64d8ec1f980d'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33a9836-a549-436f-b692-99970463a192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33a9836-a549-436f-b692-99970463a192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c699a9e-1f81-49f8-a7fb-0be5f11493ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:14 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Volume 7d0595d4-2cfa-492c-be9a-eaf380378a89: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d0595d4-2cfa-492c-be9a-eaf380378a89', 'volume_size': 1, 'snapshot_id': 'd6590dea-2d4e-4404-879e-64d8ec1f980d'} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:14 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 Jul 28 14:47:14 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:15 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:15 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 1G Jul 28 14:47:15 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:15 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 1G" returned: 0 in 0.381s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:15 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 Jul 28 14:47:15 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:15 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:15 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 is being set with open permissions: ugo+rw Jul 28 14:47:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:15 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 Jul 28 14:47:15 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:16 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:16 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info Jul 28 14:47:16 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:16 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info" returned: 0 in 0.244s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:16 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info is being set with open permissions: ugo+rw Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:16 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info Jul 28 14:47:16 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:16 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.info" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.714s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d-7d0595d4-2cfa-492c-be9a-eaf380378a89" by "_create_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d-7d0595d4-2cfa-492c-be9a-eaf380378a89" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Creating volume 7d0595d4-2cfa-492c-be9a-eaf380378a89 from snapshot d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" by "_copy_volume_from_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] snapshot: d6590dea-2d4e-4404-879e-64d8ec1f980d, volume: 7d0595d4-2cfa-492c-be9a-eaf380378a89, {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 28 14:47:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-56a37b08-1e91-4256-a7db-622d103aa569 tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285301e-e98f-48cb-bf86-99d0b8c74128]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:16 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:16 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:17 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Creating direct copy from snapshot {{(pid=87385) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f075e-f92a-4ebb-9d3e-3884bf18a8a7]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:17 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:17 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:17 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.343s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.utils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Path /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 not found in is_blk_device check {{(pid=87385) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:17 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 Jul 28 14:47:17 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-a6fded97-4888-4bba-96bc-2c2a7b912098-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-a6fded97-4888-4bba-96bc-2c2a7b912098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-a6fded97-4888-4bba-96bc-2c2a7b912098" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a6fded97-4888-4bba-96bc-2c2a7b912098" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot a6fded97-4888-4bba-96bc-2c2a7b912098 of volume 2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31a344e-f1f7-40ed-9ff3-63b4791cd8b3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:17 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 Jul 28 14:47:17 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:18 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098" returned: 0 in 0.541s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:18 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e62a2f-b29f-46c4-be59-a37d7c1b2e03]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:18 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 Jul 28 14:47:18 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:19 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" returned: 0 in 0.777s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:19 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 Jul 28 14:47:19 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:19 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098" returned: 0 in 0.609s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:19 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098 Jul 28 14:47:19 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:20 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5.a6fded97-4888-4bba-96bc-2c2a7b912098" returned: 0 in 0.422s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a6fded97-4888-4bba-96bc-2c2a7b912098" released by "_delete_snapshot" :: held 2.533s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" released by "delete_snapshot" :: held 2.562s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:20 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Created reservations ['7f1e9891-a2d2-435b-a447-867a8d5e2d3f', '4bd29418-36f6-4b69-93c9-b50db8623455', 'cad2b511-09d5-4bf4-9e4c-abfac3de50b1', '4cddddf3-0c61-48d3-a981-73480c499509'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:20 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:47:20 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-358f3900-ce51-49b8-83be-3054f6088ca4 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-a6fded97-4888-4bba-96bc-2c2a7b912098-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" acquired by "delete_volume" :: waited 0.049s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbcb6f7-5c80-463f-b70a-76d6482747da]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:21 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 Jul 28 14:47:21 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:22 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89" returned: 0 in 4.631s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" returned: 0 in 0.709s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7eb505-20aa-4ab3-ab7a-08f1e7ce74f3]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:22 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5 Jul 28 14:47:22 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:22 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:22 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:22 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5" released by "delete_volume" :: held 1.090s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Created reservations ['33005adf-326b-4299-aca2-eaad46d650f6', '4ac17a85-0b1d-4690-8197-92e413085164', '24996210-fa7a-4351-81dc-af4b5f86ec2f', 'c381cd1d-6e56-4fc2-8842-e96a17c3e115'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:22 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:22 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:22 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.538s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.image.image_utils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Image conversion details: src /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 {{(pid=87385) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 28 14:47:22 devstack cinder-volume[87385]: INFO cinder.image.image_utils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Converted 1024.00 MB image at 221.05 MB/s Jul 28 14:47:22 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 is being set with open permissions: ugo+rw Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:22 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 Jul 28 14:47:22 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:22 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.261s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:22 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-966b83f9-225b-4f31-aff9-bd3961938985 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2eba454f-e0d1-4ca3-a655-d3601d3eb5d5-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:22 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" released by "_copy_volume_from_snapshot" :: held 6.234s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d-7d0595d4-2cfa-492c-be9a-eaf380378a89" released by "_create_volume_from_snapshot" :: held 6.275s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.314s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.016s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:22 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Creating offline snapshot b371dc8f-2c88-4695-b08e-8496fcc2b557 of volume bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c699a9e-1f81-49f8-a7fb-0be5f11493ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0595d4-2cfa-492c-be9a-eaf380378a89', 'volume_size': 1, 'snapshot_id': 'd6590dea-2d4e-4404-879e-64d8ec1f980d'}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a720f96-1f5b-407f-86a5-a97d8b0149eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[124d2963-9982-419f-bab4-dd2fa75717db]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:23 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Volume volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 (7d0595d4-2cfa-492c-be9a-eaf380378a89): created successfully Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a720f96-1f5b-407f-86a5-a97d8b0149eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Flow 'volume_create_manager' (9b72f71a-002c-4858-b1e4-29de473f6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3dd38565-6901-479c-862b-693d544fca88 tempest-SnapshotDependencyTests-2047842675 None] Created volume successfully. Jul 28 14:47:23 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 Jul 28 14:47:23 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:23 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748" returned: 0 in 0.398s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:23 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 1G Jul 28 14:47:23 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-d6590dea-2d4e-4404-879e-64d8ec1f980d-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-d6590dea-2d4e-4404-879e-64d8ec1f980d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Deleting offline snapshot d6590dea-2d4e-4404-879e-64d8ec1f980d of volume e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] snapshot_file for this snap is: volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd2b50-d71c-40ab-bcd9-356dcc7df99b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:23 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:23 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:23 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 1G" returned: 0 in 0.483s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:23 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 Jul 28 14:47:23 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (86e10e64-c9d5-4bdc-b2ac-7b4c24d7fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c82adad-48aa-46e9-9f61-976878e41700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:23 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ba2b47-7460-4726-86de-a3d24808cfef]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c82adad-48aa-46e9-9f61-976878e41700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142313142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f77d657-8b1d-401e-8b99-d5109b12c169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:24Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9ae1d2-603e-421c-bb2d-1ab41317c306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9ae1d2-603e-421c-bb2d-1ab41317c306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a92e43-d503-496f-abda-567010bf352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a92e43-d503-496f-abda-567010bf352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f77d657-8b1d-401e-8b99-d5109b12c169', 'volume_name': 'volume-4f77d657-8b1d-401e-8b99-d5109b12c169', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e9995-45e4-4d60-854c-9364858799e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0e9995-45e4-4d60-854c-9364858799e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b300b513-5dff-4af5-b04f-c40f1d88283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:24 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Volume 4f77d657-8b1d-401e-8b99-d5109b12c169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f77d657-8b1d-401e-8b99-d5109b12c169', 'volume_size': 1} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:24 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:24 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:24 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 is being set with open permissions: ugo+rw Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 Jul 28 14:47:24 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.366s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:24 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info Jul 28 14:47:24 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.336s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d Jul 28 14:47:24 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:24 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info is being set with open permissions: ugo+rw Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:24 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info Jul 28 14:47:24 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:24 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927.d6590dea-2d4e-4404-879e-64d8ec1f980d" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-d6590dea-2d4e-4404-879e-64d8ec1f980d" released by "_delete_snapshot" :: held 1.445s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" released by "delete_snapshot" :: held 1.473s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:25 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.info" returned: 0 in 0.251s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142313142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f77d657-8b1d-401e-8b99-d5109b12c169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:24Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Creating volume 4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:25 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:25 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 1073741824 Jul 28 14:47:25 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0b87439d-ae8b-4b0d-b998-0a6776b4433c tempest-ProjectReaderTests-1572818496 None] Create snapshot completed successfully Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Created reservations ['163a28aa-1061-4a24-9eac-4787747496e5', 'bc33ff2a-f697-4cc0-8154-4bf1b2455cb0', '3ba7c58d-3382-44c6-a39d-aab77e47166b', 'ab4c1f62-e5c1-4fb5-8b18-761a4b79eb5e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Delete snapshot completed successfully. Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-63ef4d55-1244-41ce-aee7-bfdb1b47c908 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-d6590dea-2d4e-4404-879e-64d8ec1f980d-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:25 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 1073741824" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:25 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 Jul 28 14:47:25 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-b371dc8f-2c88-4695-b08e-8496fcc2b557-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-b371dc8f-2c88-4695-b08e-8496fcc2b557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-b371dc8f-2c88-4695-b08e-8496fcc2b557" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b371dc8f-2c88-4695-b08e-8496fcc2b557" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Deleting offline snapshot b371dc8f-2c88-4695-b08e-8496fcc2b557 of volume bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] snapshot_file for this snap is: volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e5a80-cde0-4f70-84bb-22a78fa715d1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-e639bb0f-cd13-4771-9ecc-87ef37e9f927-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-e639bb0f-cd13-4771-9ecc-87ef37e9f927-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:25 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169" returned: 0 in 0.291s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:25 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 Jul 28 14:47:25 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b300b513-5dff-4af5-b04f-c40f1d88283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f77d657-8b1d-401e-8b99-d5109b12c169', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e51561-ef4d-4dda-921f-6e92785a6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee420da-5c1d-4917-9f14-f4374d84b482]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:25 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Volume volume-4f77d657-8b1d-401e-8b99-d5109b12c169 (4f77d657-8b1d-401e-8b99-d5109b12c169): created successfully Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e51561-ef4d-4dda-921f-6e92785a6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:25 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (86e10e64-c9d5-4bdc-b2ac-7b4c24d7fd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8dbdc12b-15b5-48a3-a0ab-b8adf4ca6fb9 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:25 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:25 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfbca5db-08e5-4c54-a02e-23bd3048c748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[e306f9bd-9a15-4b2a-96e8-e08bbc5210c4]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 of volume 4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc39434-8c12-4cad-a02b-0f7217c75f6c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.412s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 Jul 28 14:47:26 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927 Jul 28 14:47:26 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 Jul 28 14:47:26 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e639bb0f-cd13-4771-9ecc-87ef37e9f927" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-e639bb0f-cd13-4771-9ecc-87ef37e9f927" released by "delete_volume" :: held 0.750s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748" returned: 0 in 0.388s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 Jul 28 14:47:26 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Created reservations ['d8a7156c-6a09-452d-9567-edfdb500a2eb', 'ccf16e82-77c5-47eb-b25b-e1140bbd7a41', '65a268c0-b765-4740-a2ce-18dceafaaeba', '791e9231-2257-4932-b79b-bd77c99a0f40'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:26 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169" returned: 0 in 0.419s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 1G Jul 28 14:47:26 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:26 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-7d0595d4-2cfa-492c-be9a-eaf380378a89-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-7d0595d4-2cfa-492c-be9a-eaf380378a89-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:26 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557" returned: 0 in 0.431s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:26 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:26 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557 Jul 28 14:47:26 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.317s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Deleted volume successfully. Jul 28 14:47:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-2e343d6d-72c7-435d-aaaa-1d6f44d30af2 tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-e639bb0f-cd13-4771-9ecc-87ef37e9f927-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa8f77-1c93-48a2-8818-b9346eea70ff]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 1G" returned: 0 in 0.511s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f77d657-8b1d-401e-8b99-d5109b12c169 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 Jul 28 14:47:27 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:27 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f77d657-8b1d-401e-8b99-d5109b12c169 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 Jul 28 14:47:27 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:27 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748.b371dc8f-2c88-4695-b08e-8496fcc2b557" returned: 0 in 0.290s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-b371dc8f-2c88-4695-b08e-8496fcc2b557" released by "_delete_snapshot" :: held 1.666s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" released by "delete_snapshot" :: held 1.690s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Created reservations ['b2913866-7fbd-4bac-af5f-e37ca5307ed7', '12a46d12-66ab-4b47-9063-b5684ac24c3e', 'a7c94ad6-5547-4de0-8ac2-ff4bed473844', '914389fe-ef6c-4168-9d72-e590f6aed6a1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:27 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Delete snapshot completed successfully. Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b2c0264a-0750-40ee-9faf-c5db2af2f902 tempest-ProjectReaderTests-1572818496 None] Lock "cinder-b371dc8f-2c88-4695-b08e-8496fcc2b557-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:27 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f77d657-8b1d-401e-8b99-d5109b12c169 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" returned: 0 in 0.303s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 is being set with open permissions: ugo+rw Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89 Jul 28 14:47:27 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:27 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 Jul 28 14:47:27 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:27 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7d0595d4-2cfa-492c-be9a-eaf380378a89" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-bfbca5db-08e5-4c54-a02e-23bd3048c748-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-quobyte-7d0595d4-2cfa-492c-be9a-eaf380378a89" released by "delete_volume" :: held 0.715s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "cinder-bfbca5db-08e5-4c54-a02e-23bd3048c748-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info Jul 28 14:47:27 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Acquiring lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Created reservations ['3cba03bf-172c-4a7f-9306-1be827713e44', '0e95bd50-a8d6-4915-970f-455b9070186f', '71f97525-4b13-45d6-8644-d6e6fd05be1d', '96c0a707-fc8a-4749-b4a6-4975691cc954'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" acquired by "delete_volume" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bb8bc4-6ae1-4f86-a2cc-11a75511021c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:27 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:27 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:27 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:28 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 Jul 28 14:47:28 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:28 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info" returned: 0 in 0.286s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:28 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info is being set with open permissions: ugo+rw Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:28 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info Jul 28 14:47:28 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:28 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.301s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Deleted volume successfully. Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-fb5fa785-f358-4f42-8716-629f02c8a8fc tempest-SnapshotDependencyTests-2047842675 None] Lock "cinder-7d0595d4-2cfa-492c-be9a-eaf380378a89-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:28 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748" returned: 0 in 0.425s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:28 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.info" returned: 0 in 0.274s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:28 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748 Jul 28 14:47:28 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:28 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-da65d156-b181-41ec-890f-f05ca6acc970 tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:47:28 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-bfbca5db-08e5-4c54-a02e-23bd3048c748" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "cinder-quobyte-bfbca5db-08e5-4c54-a02e-23bd3048c748" released by "delete_volume" :: held 0.746s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Created reservations ['f4fd3194-4e3b-4e69-a983-8a74be2c5343', '04ed37a5-9594-46e6-af49-bc428604ae1c', '939acba3-a438-44ba-bde2-9eca9ee70cb9', 'cfaaf850-de8c-4e52-9f12-737d7647c614'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:28 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:28 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:28 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:29 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.298s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:29 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Deleted volume successfully. Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-e263e159-a92a-4d2d-a07d-0049d7ff7f6b tempest-ProjectReaderTests-1572818496 None] Lock "cinder-bfbca5db-08e5-4c54-a02e-23bd3048c748-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 of volume 4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559d730-873e-49e9-95fb-ee03413a48f9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:29 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 Jul 28 14:47:29 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:29 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" returned: 0 in 0.412s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f77d657-8b1d-401e-8b99-d5109b12c169(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c28a3-4d4a-4c75-a068-cd787822e85a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:29 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:30 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 Jul 28 14:47:30 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:30 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169" returned: 0 in 0.446s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:30 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 Jul 28 14:47:30 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:30 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" returned: 0 in 0.424s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:30 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:30 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129 Jul 28 14:47:30 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:31 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169.ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129" released by "_delete_snapshot" :: held 1.735s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" released by "delete_snapshot" :: held 1.764s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Created reservations ['0d47f5a2-1bf6-41d6-90ed-8dc600cb9582', 'e7da951e-bf3f-45c5-ace3-98c1d86b95ca', '6770e9d0-f6a2-4e8c-99f2-d838e9253e0b', '43abe851-37ee-4901-8b8f-655cf08cc19d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:31 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-80c55dc3-d103-4533-bebd-7ce50b22278c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-ce1b2a1c-3046-47ba-be82-4b0fbf0a4129-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-4f77d657-8b1d-401e-8b99-d5109b12c169-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-4f77d657-8b1d-401e-8b99-d5109b12c169-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[32143eb9-9cc6-4999-900f-b1c14e57f6f6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:31 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:31 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 Jul 28 14:47:31 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:32 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169" returned: 0 in 0.470s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:32 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169 Jul 28 14:47:32 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:32 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4f77d657-8b1d-401e-8b99-d5109b12c169" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-4f77d657-8b1d-401e-8b99-d5109b12c169" released by "delete_volume" :: held 0.815s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Created reservations ['60a56087-163d-4abb-9e34-3e64ac44c2ea', 'd580cb87-d1e3-45d9-8ac1-f6f27f41e35c', 'ac2e2851-7c67-42e8-82ae-57053cc8f323', '8d7b6e71-7fe6-468f-8362-5a31769e8971'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:32 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:32 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:32 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.312s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:32 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:47:32 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-689c64a0-f4a9-4f56-8a21-ea7d28d6a981 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-4f77d657-8b1d-401e-8b99-d5109b12c169-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (1854cd8e-e577-432e-bef0-259322da84ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452c125a-b40d-40b6-8e9f-221a27178039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452c125a-b40d-40b6-8e9f-221a27178039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726676372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8a8a03-939e-4c08-99a2-7111ba1b4992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:34Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa5f44-cbc8-4980-8fbc-4bc190a05334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa5f44-cbc8-4980-8fbc-4bc190a05334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0263c7-555d-4614-9da8-9432b7502217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0263c7-555d-4614-9da8-9432b7502217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8a8a03-939e-4c08-99a2-7111ba1b4992', 'volume_name': 'volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eae806-5da2-4d4f-8b19-e6e76f18f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eae806-5da2-4d4f-8b19-e6e76f18f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dee85e-acb5-40b1-ade1-0c7aced0fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:33 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Volume 2f8a8a03-939e-4c08-99a2-7111ba1b4992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992', 'volume_size': 1} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726676372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8a8a03-939e-4c08-99a2-7111ba1b4992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:34Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Creating volume 2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:33 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:33 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:33 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 1073741824 Jul 28 14:47:33 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:34 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 1073741824" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:34 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 Jul 28 14:47:34 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:34 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992" returned: 0 in 0.306s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dee85e-acb5-40b1-ade1-0c7aced0fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88783c92-56f6-42b6-b5c6-f06f49c71d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:34 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Volume volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 (2f8a8a03-939e-4c08-99a2-7111ba1b4992): created successfully Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88783c92-56f6-42b6-b5c6-f06f49c71d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:34 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (1854cd8e-e577-432e-bef0-259322da84ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:34 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-905f6f4d-be9e-4a48-b2ca-c323bebc0ca3 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:35 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 95f1f837-3eee-4065-be91-195918ed9bc3 of volume 2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:35 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1c089-cb9f-4c28-b420-91e17225cac8]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:35 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:35 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 Jul 28 14:47:35 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:36 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992" returned: 0 in 0.380s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:36 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 1G Jul 28 14:47:36 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:36 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 1G" returned: 0 in 0.437s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:36 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 Jul 28 14:47:36 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:36 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3" returned: 0 in 0.375s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:36 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 is being set with open permissions: ugo+rw Jul 28 14:47:36 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:36 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 Jul 28 14:47:36 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:37 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:37 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info Jul 28 14:47:37 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:37 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info" returned: 0 in 0.282s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:37 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info is being set with open permissions: ugo+rw Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:37 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info Jul 28 14:47:37 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:37 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.info" returned: 0 in 0.299s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:37 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:37 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-763d7d42-9cb0-42ae-8a42-23c247a73f9c tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-95f1f837-3eee-4065-be91-195918ed9bc3-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-95f1f837-3eee-4065-be91-195918ed9bc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-95f1f837-3eee-4065-be91-195918ed9bc3" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-95f1f837-3eee-4065-be91-195918ed9bc3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 95f1f837-3eee-4065-be91-195918ed9bc3 of volume 2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13124d3-7ce8-4463-82cd-7b1c017a3886]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:38 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:39 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 Jul 28 14:47:39 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:39 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3" returned: 0 in 0.370s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c661d-37a9-483d-9cf5-b1d2db815fc5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:39 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 Jul 28 14:47:39 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:39 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992" returned: 0 in 0.383s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:39 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:39 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 Jul 28 14:47:39 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:40 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3" returned: 0 in 0.375s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:40 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3 Jul 28 14:47:40 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:40 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992.95f1f837-3eee-4065-be91-195918ed9bc3" returned: 0 in 0.256s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-95f1f837-3eee-4065-be91-195918ed9bc3" released by "_delete_snapshot" :: held 1.486s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" released by "delete_snapshot" :: held 1.506s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Created reservations ['17051583-a2e8-42ed-874d-efafbd841bbf', '4d5f0d1e-4074-435b-97d6-fc4d50d5fae5', 'a47c26cf-764f-4eb7-a90a-ccdd44fb2b34', 'c3ea6537-17e6-4fa1-bccc-7c80658af11d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:40 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:47:40 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b427bebb-4c80-4fcc-a4c3-509e844869bc tempest-ProjectMemberTests-1414835863 None] Lock "cinder-95f1f837-3eee-4065-be91-195918ed9bc3-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-2f8a8a03-939e-4c08-99a2-7111ba1b4992-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2f8a8a03-939e-4c08-99a2-7111ba1b4992-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d848f4-66cc-4b5c-967d-b4fd35b46d23]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:41 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 Jul 28 14:47:41 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:41 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992" returned: 0 in 0.401s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:41 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992 Jul 28 14:47:41 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:41 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-2f8a8a03-939e-4c08-99a2-7111ba1b4992" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2f8a8a03-939e-4c08-99a2-7111ba1b4992" released by "delete_volume" :: held 0.715s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Created reservations ['e32023b0-be65-40bc-bc6f-045063a8e707', '0fa3da10-20a7-4ad4-bde7-49db57fa4111', '4bc57c4e-795e-4a41-b19e-cd2eb7e7969c', '87971915-603e-4dc5-9f53-3bc81d9ea301'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:41 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:41 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:41 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:42 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:42 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Flow 'volume_create_manager' (9652157c-85fa-4c1e-b0db-0936969200c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f96270a-9b46-4869-90d6-0d057acd53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-6aa72d1f-dea8-4411-8962-588b57cfa688 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2f8a8a03-939e-4c08-99a2-7111ba1b4992-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f96270a-9b46-4869-90d6-0d057acd53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207964031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05591345-0d04-4eb4-bc11-89c59e572ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1a5606a5b4a65a93b5e32f1c7fc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:42Z,use_quota=True,user_id='d68ba45fd96f4a56b24227362da4c02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4147248-2880-4e9f-b050-1b5b92d9ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4147248-2880-4e9f-b050-1b5b92d9ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e057d4a-5681-4268-b8e6-b527a7f89319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e057d4a-5681-4268-b8e6-b527a7f89319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05591345-0d04-4eb4-bc11-89c59e572ffd', 'volume_name': 'volume-05591345-0d04-4eb4-bc11-89c59e572ffd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf19eb6-5017-457a-8bef-f2228d2b265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf19eb6-5017-457a-8bef-f2228d2b265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f583d900-9df6-4ad9-9e6c-26fedb9a9ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Volume 05591345-0d04-4eb4-bc11-89c59e572ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05591345-0d04-4eb4-bc11-89c59e572ffd', 'volume_size': 1} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207964031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05591345-0d04-4eb4-bc11-89c59e572ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1a5606a5b4a65a93b5e32f1c7fc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:42Z,use_quota=True,user_id='d68ba45fd96f4a56b24227362da4c02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Creating volume 05591345-0d04-4eb4-bc11-89c59e572ffd {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:42 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:42 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd 1073741824 Jul 28 14:47:42 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (180b3b27-72b3-4263-91f3-b9f0c9cc95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6a792c-ac77-41c9-9ff6-c900d95f0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6a792c-ac77-41c9-9ff6-c900d95f0313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090e5d28-c408-47b3-a69b-6297e39e5d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:43Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc893c2-e9c8-4bd9-9405-740215ce3285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc893c2-e9c8-4bd9-9405-740215ce3285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba4a8a-fcd2-47d8-aebd-7cd09710e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba4a8a-fcd2-47d8-aebd-7cd09710e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090e5d28-c408-47b3-a69b-6297e39e5d3d', 'volume_name': 'volume-090e5d28-c408-47b3-a69b-6297e39e5d3d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18321522-4de1-4b3f-b629-7a5fef3776be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18321522-4de1-4b3f-b629-7a5fef3776be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32662d21-0108-433a-8130-397324542895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:42 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Volume 090e5d28-c408-47b3-a69b-6297e39e5d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090e5d28-c408-47b3-a69b-6297e39e5d3d', 'volume_size': 1} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:42 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd 1073741824" returned: 0 in 0.464s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:42 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:42 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd Jul 28 14:47:42 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:43 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd" returned: 0 in 0.235s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090e5d28-c408-47b3-a69b-6297e39e5d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:43Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Creating volume 090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:43 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f583d900-9df6-4ad9-9e6c-26fedb9a9ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05591345-0d04-4eb4-bc11-89c59e572ffd', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:43 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d 1073741824 Jul 28 14:47:43 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda27e-6c89-42d4-ad40-5f280365bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:43 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Volume volume-05591345-0d04-4eb4-bc11-89c59e572ffd (05591345-0d04-4eb4-bc11-89c59e572ffd): created successfully Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda27e-6c89-42d4-ad40-5f280365bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Flow 'volume_create_manager' (9652157c-85fa-4c1e-b0db-0936969200c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-939afb55-3d8c-4d04-9d4b-eecb11ffc0e6 tempest-ProjectReaderTests-1063044703 None] Created volume successfully. Jul 28 14:47:43 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d 1073741824" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:43 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d Jul 28 14:47:43 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:43 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d" returned: 0 in 0.252s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32662d21-0108-433a-8130-397324542895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090e5d28-c408-47b3-a69b-6297e39e5d3d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef25073-a5ac-4ab9-82c2-08ab9df836a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:43 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Volume volume-090e5d28-c408-47b3-a69b-6297e39e5d3d (090e5d28-c408-47b3-a69b-6297e39e5d3d): created successfully Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef25073-a5ac-4ab9-82c2-08ab9df836a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:43 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (180b3b27-72b3-4263-91f3-b9f0c9cc95ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:43 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3ec1611f-3b46-4294-9042-731663d8eed5 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Acquiring lock "cinder-05591345-0d04-4eb4-bc11-89c59e572ffd-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "cinder-05591345-0d04-4eb4-bc11-89c59e572ffd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Acquiring lock "cinder-quobyte-05591345-0d04-4eb4-bc11-89c59e572ffd" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "cinder-quobyte-05591345-0d04-4eb4-bc11-89c59e572ffd" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67e18f-0cd4-4931-aea5-d36bc0135896]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:44 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd Jul 28 14:47:44 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:44 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd" returned: 0 in 0.378s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 6652a41b-e833-42c7-a75f-2b5170266bcb of volume 090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:44 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd Jul 28 14:47:44 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a367bc-bcd6-4621-b32c-896aeb483f5f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:44 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:45 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d Jul 28 14:47:45 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:45 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-05591345-0d04-4eb4-bc11-89c59e572ffd" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "cinder-quobyte-05591345-0d04-4eb4-bc11-89c59e572ffd" released by "delete_volume" :: held 0.660s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Created reservations ['9cd1cebb-09cf-40c1-a4e1-7f5918f6d34a', '38f20edf-d780-4110-be78-f0c48a2145e0', 'fee50dd7-008f-4cc9-8f33-74f6ee2e973a', '8ad2f26d-d16b-4122-9bee-2e42b08c15c0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:45 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:45 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:45 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d" returned: 0 in 0.369s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:45 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb 1G Jul 28 14:47:45 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:45 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.254s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:45 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Deleted volume successfully. Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-beb96f9d-0c13-4839-ad8e-5853b90669e4 tempest-ProjectReaderTests-1063044703 None] Lock "cinder-05591345-0d04-4eb4-bc11-89c59e572ffd-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:45 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb 1G" returned: 0 in 0.425s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:45 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090e5d28-c408-47b3-a69b-6297e39e5d3d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:45 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090e5d28-c408-47b3-a69b-6297e39e5d3d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb Jul 28 14:47:45 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:46 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090e5d28-c408-47b3-a69b-6297e39e5d3d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb" returned: 0 in 0.305s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:46 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb is being set with open permissions: ugo+rw Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:46 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb Jul 28 14:47:46 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Flow 'volume_create_manager' (448e34c1-266b-4f08-8144-aad8fb9ec1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd55477-57ad-4f8a-bf34-9ad4fb521f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd55477-57ad-4f8a-bf34-9ad4fb521f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693793318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e72bae-efaa-4ded-ad89-db98cdb9c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1a5606a5b4a65a93b5e32f1c7fc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:46Z,use_quota=True,user_id='d68ba45fd96f4a56b24227362da4c02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a18b7a-e00b-477e-bb56-c2adb8120839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a18b7a-e00b-477e-bb56-c2adb8120839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9d4c2-f205-4e7c-aab4-3e55c1d994c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe9d4c2-f205-4e7c-aab4-3e55c1d994c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e72bae-efaa-4ded-ad89-db98cdb9c5d0', 'volume_name': 'volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42351567-bc59-4797-be14-31577b5a718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42351567-bc59-4797-be14-31577b5a718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eedd9b-2d9a-45b8-8275-15ce414c7230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:46 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Volume e0e72bae-efaa-4ded-ad89-db98cdb9c5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0', 'volume_size': 1} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:46 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb" returned: 0 in 0.237s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:46 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info Jul 28 14:47:46 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:46 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:46 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info is being set with open permissions: ugo+rw Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:46 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info Jul 28 14:47:46 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:46 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.info" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693793318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e72bae-efaa-4ded-ad89-db98cdb9c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a1a5606a5b4a65a93b5e32f1c7fc50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:46Z,use_quota=True,user_id='d68ba45fd96f4a56b24227362da4c02a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Creating volume e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:46 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:46 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 1073741824 Jul 28 14:47:46 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:46 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-cac52e17-d2ee-4db0-a58d-0b09cb31753d tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:47:46 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-6652a41b-e833-42c7-a75f-2b5170266bcb-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-6652a41b-e833-42c7-a75f-2b5170266bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-6652a41b-e833-42c7-a75f-2b5170266bcb" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-6652a41b-e833-42c7-a75f-2b5170266bcb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 6652a41b-e833-42c7-a75f-2b5170266bcb of volume 090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a6ad48-50ff-4b28-b20b-fa970268b85c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:47 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb Jul 28 14:47:47 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:47 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 1073741824" returned: 0 in 0.415s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:47 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 Jul 28 14:47:47 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:47 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090e5d28-c408-47b3-a69b-6297e39e5d3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eb89b7-c952-4259-9b1d-ea42a8ebaada]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:47 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eedd9b-2d9a-45b8-8275-15ce414c7230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4f4869-df4e-48ca-b31d-a02b6e34173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:47 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Volume volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 (e0e72bae-efaa-4ded-ad89-db98cdb9c5d0): created successfully Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4f4869-df4e-48ca-b31d-a02b6e34173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Flow 'volume_create_manager' (448e34c1-266b-4f08-8144-aad8fb9ec1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:47 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-236f17f5-3284-4dd4-b2ab-6004e783f7ac tempest-ProjectReaderTests-1063044703 None] Created volume successfully. Jul 28 14:47:47 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d Jul 28 14:47:47 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:47 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d" returned: 0 in 0.358s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:47 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:47 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb Jul 28 14:47:47 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:48 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Acquiring lock "cinder-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb" returned: 0 in 0.352s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "cinder-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:48 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb Jul 28 14:47:48 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Acquiring lock "cinder-quobyte-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "cinder-quobyte-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" acquired by "delete_volume" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9892e0a-0e99-4377-a090-84ef19d9a34a]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:48 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 Jul 28 14:47:48 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:48 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d.6652a41b-e833-42c7-a75f-2b5170266bcb" returned: 0 in 0.258s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-6652a41b-e833-42c7-a75f-2b5170266bcb" released by "_delete_snapshot" :: held 1.423s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" released by "delete_snapshot" :: held 1.447s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Created reservations ['92d4dc1d-1351-40d8-9d2d-bc55f97110ba', '4ace8277-c360-4609-a8ac-87d34a4afac7', '4c7d5078-f4ae-4486-9d5d-02086f225c71', '4f672f79-edde-4d12-9f60-9efb09cbdafb'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:48 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-535af5ea-912c-4ea9-9324-539e00c315ea tempest-ProjectMemberTests-1414835863 None] Lock "cinder-6652a41b-e833-42c7-a75f-2b5170266bcb-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:48 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" returned: 0 in 0.375s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:48 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0 Jul 28 14:47:48 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:48 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "cinder-quobyte-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0" released by "delete_volume" :: held 0.662s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:48 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Created reservations ['6c800c48-8b9c-4511-803d-97bb2ecf55d2', 'c3c2abc8-e614-4231-9751-f7ca0f7f0e64', '85fb40f9-da78-45b3-b624-16de9b5bd540', 'aeb5ae92-b94d-4f92-95dc-1c3cff61c937'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:49 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:49 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-090e5d28-c408-47b3-a69b-6297e39e5d3d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-090e5d28-c408-47b3-a69b-6297e39e5d3d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:49 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:49 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:49 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.279s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57dd846-4232-4438-bc04-7d06c3489e30]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:49 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Deleted volume successfully. Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-3dfa430f-e086-4a19-a244-afe44894a4ca tempest-ProjectReaderTests-1063044703 None] Lock "cinder-e0e72bae-efaa-4ded-ad89-db98cdb9c5d0-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:49 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d Jul 28 14:47:49 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:49 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 28 14:47:49 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d" returned: 0 in 0.380s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:49 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d Jul 28 14:47:49 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:49 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-090e5d28-c408-47b3-a69b-6297e39e5d3d" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:49 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-090e5d28-c408-47b3-a69b-6297e39e5d3d" released by "delete_volume" :: held 0.701s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Created reservations ['bbaa64cd-bfbb-409a-af50-ad0f26f7656a', 'cbd0df32-fb9e-4841-b359-5967a4294ced', '93412f62-9abc-4fea-915e-7769f87030fd', 'd78bca95-e515-44e8-8c17-67d8dad1a7e0'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:50 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:50 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:50 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.275s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:50 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-db9e614b-f2a0-415c-8425-5e476007e494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-090e5d28-c408-47b3-a69b-6297e39e5d3d-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (dd46bbac-e729-4029-b747-41a6d18b7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba61266-e2dd-42fb-857c-3eaee1613a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba61266-e2dd-42fb-857c-3eaee1613a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486696313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e481908-c132-4bd7-8713-43f204bdac4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:51Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060c635-5a58-4aa7-9bf7-59ec7feb9a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060c635-5a58-4aa7-9bf7-59ec7feb9a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d07f12-3eec-425a-895f-16cdf5f372ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d07f12-3eec-425a-895f-16cdf5f372ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e481908-c132-4bd7-8713-43f204bdac4f', 'volume_name': 'volume-8e481908-c132-4bd7-8713-43f204bdac4f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a189f5-8378-47e2-9edc-3187b491ed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a189f5-8378-47e2-9edc-3187b491ed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab54a72-487d-4065-a151-5c064c3bf531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:50 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Volume 8e481908-c132-4bd7-8713-43f204bdac4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e481908-c132-4bd7-8713-43f204bdac4f', 'volume_size': 1} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486696313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e481908-c132-4bd7-8713-43f204bdac4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:51Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Creating volume 8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:50 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:50 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:50 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f 1073741824 Jul 28 14:47:50 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:51 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f 1073741824" returned: 0 in 0.405s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:51 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f Jul 28 14:47:51 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:51 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f" returned: 0 in 0.266s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab54a72-487d-4065-a151-5c064c3bf531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e481908-c132-4bd7-8713-43f204bdac4f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5173f2-7d09-4c78-8644-2d7b4833f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:51 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Volume volume-8e481908-c132-4bd7-8713-43f204bdac4f (8e481908-c132-4bd7-8713-43f204bdac4f): created successfully Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5173f2-7d09-4c78-8644-2d7b4833f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (dd46bbac-e729-4029-b747-41a6d18b7b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:51 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-af0439a6-f790-4428-b8ec-dbd3dd2b4814 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:51 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 682facac-c868-40cf-a372-f03489c20cc0 of volume 8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[499870af-b7f3-4272-8284-3ebbc80c1020]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:52 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f Jul 28 14:47:52 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:52 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f" returned: 0 in 0.365s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:52 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 1G Jul 28 14:47:52 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:52 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 1G" returned: 0 in 0.409s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:52 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e481908-c132-4bd7-8713-43f204bdac4f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:52 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e481908-c132-4bd7-8713-43f204bdac4f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 Jul 28 14:47:52 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:53 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e481908-c132-4bd7-8713-43f204bdac4f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0" returned: 0 in 0.307s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:53 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 is being set with open permissions: ugo+rw Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:53 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 Jul 28 14:47:53 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (0d51783b-e4f5-423e-ae03-5cca8b51e7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3b3a13-9e03-4f76-a660-9d72570c8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3b3a13-9e03-4f76-a660-9d72570c8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428127637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0b8de-7db0-4193-bd0a-99cd0a2baccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:53Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f763d-af21-4ae2-92aa-c423ce118e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f763d-af21-4ae2-92aa-c423ce118e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2fa56-bb64-49f5-a16b-2ff4c9ff4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f2fa56-bb64-49f5-a16b-2ff4c9ff4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0b8de-7db0-4193-bd0a-99cd0a2baccf', 'volume_name': 'volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e092148-9be3-4359-8823-0a12ff04ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e092148-9be3-4359-8823-0a12ff04ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca808185-9cef-4c90-b3a7-488a7e379333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:53 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Volume 81a0b8de-7db0-4193-bd0a-99cd0a2baccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf', 'volume_size': 1} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:53 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:53 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info Jul 28 14:47:53 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:53 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:53 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info is being set with open permissions: ugo+rw Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:53 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info Jul 28 14:47:53 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:53 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.info" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1428127637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0b8de-7db0-4193-bd0a-99cd0a2baccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:53Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Creating volume 81a0b8de-7db0-4193-bd0a-99cd0a2baccf {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:53 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:53 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:53 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf 1073741824 Jul 28 14:47:53 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:53 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-6cc00dd4-3d3f-40dd-9c5c-73f4af81c59d tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-682facac-c868-40cf-a372-f03489c20cc0-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-682facac-c868-40cf-a372-f03489c20cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-682facac-c868-40cf-a372-f03489c20cc0" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-682facac-c868-40cf-a372-f03489c20cc0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 682facac-c868-40cf-a372-f03489c20cc0 of volume 8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[504107ed-7b83-4a2d-92c5-6652a14bf289]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:54 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf 1073741824" returned: 0 in 0.458s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=163,cinder:UPDATE=201,cinder:INSERT=58,cinder:DELETE=22 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:47:54 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 Jul 28 14:47:54 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:54 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf Jul 28 14:47:54 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:54 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:54 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" returned: 0 in 0.245s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0" returned: 0 in 0.372s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:SELECT=171,cinder:UPDATE=221,cinder:INSERT=54,cinder:DELETE=15 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e481908-c132-4bd7-8713-43f204bdac4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca808185-9cef-4c90-b3a7-488a7e379333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e87f796-3bab-4b68-a158-23b70fcb06bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe4168-4a6b-47fb-a003-fb377c879e40]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:54 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Volume volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf (81a0b8de-7db0-4193-bd0a-99cd0a2baccf): created successfully Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e87f796-3bab-4b68-a158-23b70fcb06bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:54 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (0d51783b-e4f5-423e-ae03-5cca8b51e7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:54 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b49c886a-5967-4d39-807b-dee81efb9468 tempest-ProjectReaderTests-1934012501 None] Created volume successfully. Jul 28 14:47:54 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f Jul 28 14:47:54 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:55 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f" returned: 0 in 0.345s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:55 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 Jul 28 14:47:55 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:55 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0" returned: 0 in 0.344s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:55 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0 Jul 28 14:47:55 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-81a0b8de-7db0-4193-bd0a-99cd0a2baccf-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-81a0b8de-7db0-4193-bd0a-99cd0a2baccf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-quobyte-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d9e7a-f3b8-4a50-ba65-dc6f7ec076b1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:55 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f.682facac-c868-40cf-a372-f03489c20cc0" returned: 0 in 0.283s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:55 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf Jul 28 14:47:55 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-682facac-c868-40cf-a372-f03489c20cc0" released by "_delete_snapshot" :: held 1.467s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" released by "delete_snapshot" :: held 1.505s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Created reservations ['88ee2144-79f0-4562-b261-66a7470afae4', '1a486c2a-dfc9-44ac-994f-355c8303ae35', '6c4daa92-2185-415a-a487-213200e02e5e', 'c62923c2-e6de-4404-9155-303c54066794'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:55 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1e75794c-f337-45a9-bd43-d931a092c01c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-682facac-c868-40cf-a372-f03489c20cc0-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:55 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" returned: 0 in 0.400s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:55 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:55 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf Jul 28 14:47:55 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:56 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-81a0b8de-7db0-4193-bd0a-99cd0a2baccf" released by "delete_volume" :: held 0.681s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Created reservations ['e21e5f90-0576-46da-8c44-3a939ca8662e', '2ca02517-3300-43b1-8c33-322fb627e641', '61defd4b-467d-4a01-93d4-42de5dcf0a86', '109ba75f-5bb8-4c27-8f03-7b9872100d98'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-8e481908-c132-4bd7-8713-43f204bdac4f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "cinder-8e481908-c132-4bd7-8713-43f204bdac4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:56 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:56 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fcabc4-f90a-4285-ae74-af040e728306]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:56 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f Jul 28 14:47:56 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:56 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.261s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:56 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Deleted volume successfully. Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b383c7dd-07d8-422f-8cc5-abc672510906 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-81a0b8de-7db0-4193-bd0a-99cd0a2baccf-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:56 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f" returned: 0 in 0.399s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:56 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:56 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f Jul 28 14:47:56 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (53c00bf4-217b-4538-8a86-e964ae62d8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd153461-6ef9-4490-be8e-868db217898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd153461-6ef9-4490-be8e-868db217898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266422036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a7c7c8-44c8-4c94-a57c-35879a134f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:57Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c885a6-466d-4e19-ba08-b46fedb0b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c885a6-466d-4e19-ba08-b46fedb0b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c6aab-9d02-4d8f-b4a9-2651eefcee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085c6aab-9d02-4d8f-b4a9-2651eefcee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a7c7c8-44c8-4c94-a57c-35879a134f4e', 'volume_name': 'volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d675d7e-c40e-4f63-86ae-949ae361e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d675d7e-c40e-4f63-86ae-949ae361e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1ed1ac-3002-4622-8962-7e9dd0d8a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Volume 19a7c7c8-44c8-4c94-a57c-35879a134f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e', 'volume_size': 1} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266422036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a7c7c8-44c8-4c94-a57c-35879a134f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:57Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Creating volume 19a7c7c8-44c8-4c94-a57c-35879a134f4e {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:57 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-8e481908-c132-4bd7-8713-43f204bdac4f" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:57 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e 1073741824 Jul 28 14:47:57 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-8e481908-c132-4bd7-8713-43f204bdac4f" released by "delete_volume" :: held 0.774s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Created reservations ['da629c7d-dc2d-49af-a97e-b86a1915e0ad', 'fa646f68-1f50-4de7-8c39-dccf31f3ea2a', '52d770cd-229c-45a5-9262-92d95356b76b', 'b8237fcf-3b65-49fd-ac2b-e72fcdac3e8e'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:57 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:47:57 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:57 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:47:57 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-a25438e3-8f10-4b50-a7af-83536a2ca03d tempest-ProjectMemberTests-1414835863 None] Lock "cinder-8e481908-c132-4bd7-8713-43f204bdac4f-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:57 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e 1073741824" returned: 0 in 0.464s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:57 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e Jul 28 14:47:57 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:57 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1ed1ac-3002-4622-8962-7e9dd0d8a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd7def-cbf2-43b8-bb59-c3904e6ee17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:57 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Volume volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e (19a7c7c8-44c8-4c94-a57c-35879a134f4e): created successfully Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd7def-cbf2-43b8-bb59-c3904e6ee17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (53c00bf4-217b-4538-8a86-e964ae62d8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:57 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (1ecc9466-c823-486d-a471-fb675aad0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c44a5-d145-48d3-bf6d-63735eb4b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b3a93779-76c3-4cf5-9862-e28695c42787 tempest-ProjectReaderTests-1934012501 None] Created volume successfully. Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3c44a5-d145-48d3-bf6d-63735eb4b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983054160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a726358b-32c0-471e-a31c-923922f0478f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:58Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84c504-5c7e-4925-9dbb-ddaa699276c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d84c504-5c7e-4925-9dbb-ddaa699276c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74bf6d2-7816-4d0b-b1f2-6aa58ba08b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74bf6d2-7816-4d0b-b1f2-6aa58ba08b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a726358b-32c0-471e-a31c-923922f0478f', 'volume_name': 'volume-a726358b-32c0-471e-a31c-923922f0478f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505b429-ec11-4b73-a592-9527c310659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d505b429-ec11-4b73-a592-9527c310659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1adcf25-9c39-4c0a-9869-19415d755fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Volume a726358b-32c0-471e-a31c-923922f0478f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a726358b-32c0-471e-a31c-923922f0478f', 'volume_size': 1} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-983054160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a726358b-32c0-471e-a31c-923922f0478f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:47:58Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Creating volume a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:47:58 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:58 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f 1073741824 Jul 28 14:47:58 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:58 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f 1073741824" returned: 0 in 0.398s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:58 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f Jul 28 14:47:58 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:58 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f" returned: 0 in 0.242s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1adcf25-9c39-4c0a-9869-19415d755fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a726358b-32c0-471e-a31c-923922f0478f', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3be70fe-f1bd-47a0-b851-2f0d5a4081f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:47:58 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Volume volume-a726358b-32c0-471e-a31c-923922f0478f (a726358b-32c0-471e-a31c-923922f0478f): created successfully Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3be70fe-f1bd-47a0-b851-2f0d5a4081f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:47:58 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (1ecc9466-c823-486d-a471-fb675aad0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:47:58 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3fe7febb-9d38-45df-886d-e59f18a86425 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 of volume a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd6efac-9553-4a4a-bdcf-71055baa453f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-19a7c7c8-44c8-4c94-a57c-35879a134f4e-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-19a7c7c8-44c8-4c94-a57c-35879a134f4e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-quobyte-19a7c7c8-44c8-4c94-a57c-35879a134f4e" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-19a7c7c8-44c8-4c94-a57c-35879a134f4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:47:59 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f Jul 28 14:47:59 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89bcae-87b4-4b26-9993-2999d724a782]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:59 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e Jul 28 14:47:59 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:59 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f" returned: 0 in 0.372s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:59 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 1G Jul 28 14:47:59 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:59 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e" returned: 0 in 0.367s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:59 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e Jul 28 14:47:59 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:59 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-19a7c7c8-44c8-4c94-a57c-35879a134f4e" returned: 0 in 0.265s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:59 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 1G" returned: 0 in 0.405s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a726358b-32c0-471e-a31c-923922f0478f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-19a7c7c8-44c8-4c94-a57c-35879a134f4e" released by "delete_volume" :: held 0.687s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:47:59 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a726358b-32c0-471e-a31c-923922f0478f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 Jul 28 14:47:59 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:47:59 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Created reservations ['3c2a95b3-8a1d-43ee-b503-c84f62bfbacd', 'f4f1a8a1-3a71-4b18-8c69-33088cc710a1', '0c656ec8-9bf5-42dc-8fd7-698f57a1f8a0', 'b0fb3515-fc39-476e-be05-fecc864556e8'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:00 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:00 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:00 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a726358b-32c0-471e-a31c-923922f0478f -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" returned: 0 in 0.302s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:00 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 is being set with open permissions: ugo+rw Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:00 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 Jul 28 14:48:00 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:00 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.264s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:00 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Deleted volume successfully. Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-4fedcef3-679c-4c1d-93da-3cda4ed79814 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-19a7c7c8-44c8-4c94-a57c-35879a134f4e-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:00 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" returned: 0 in 0.248s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:00 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info Jul 28 14:48:00 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:00 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info" returned: 0 in 0.278s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:00 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info is being set with open permissions: ugo+rw Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:00 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info Jul 28 14:48:00 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (b2bde9dd-6424-4152-89a6-5375d6db6426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59647ab-16a7-4e89-9262-1e5918bc96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59647ab-16a7-4e89-9262-1e5918bc96a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677392868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3a304-e9de-47b3-a49f-b94f43a8da44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:01Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10040f85-5822-45d0-8f92-35e48122085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10040f85-5822-45d0-8f92-35e48122085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c7eb4-910d-4f22-afe8-50779dea4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c7eb4-910d-4f22-afe8-50779dea4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb3a304-e9de-47b3-a49f-b94f43a8da44', 'volume_name': 'volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51356e-6855-4d5d-80fb-bc213e5cab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51356e-6855-4d5d-80fb-bc213e5cab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648016da-fd37-4be9-99bc-cca3dc1dea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:00 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Volume 4fb3a304-e9de-47b3-a49f-b94f43a8da44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44', 'volume_size': 1} Jul 28 14:48:00 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:01 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.info" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677392868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb3a304-e9de-47b3-a49f-b94f43a8da44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:01Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Creating volume 4fb3a304-e9de-47b3-a49f-b94f43a8da44 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:48:01 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:01 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 1073741824 Jul 28 14:48:01 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0cc11e0f-336d-4545-8155-1d2c00db61a2 tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 of volume a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fee1851-603f-452b-b5bc-c97d1ef610d5]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:01 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 Jul 28 14:48:01 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:01 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 1073741824" returned: 0 in 0.420s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:01 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 Jul 28 14:48:01 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:01 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" returned: 0 in 0.404s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a726358b-32c0-471e-a31c-923922f0478f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8655a1f3-e2d6-49f9-8f60-4bd63349be7e]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:01 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648016da-fd37-4be9-99bc-cca3dc1dea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca6c5f-028e-479c-bcbe-b8ccee681a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:01 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Volume volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 (4fb3a304-e9de-47b3-a49f-b94f43a8da44): created successfully Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ca6c5f-028e-479c-bcbe-b8ccee681a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:01 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (b2bde9dd-6424-4152-89a6-5375d6db6426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:01 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0fc63cc4-56ae-42be-b49a-9a0dd8ad0d0c tempest-ProjectReaderTests-1934012501 None] Created volume successfully. Jul 28 14:48:01 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f Jul 28 14:48:01 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:02 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f" returned: 0 in 0.364s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:02 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 Jul 28 14:48:02 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:02 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" returned: 0 in 0.316s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:02 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52 Jul 28 14:48:02 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:02 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f.7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" returned: 0 in 0.244s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52" released by "_delete_snapshot" :: held 1.414s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" released by "delete_snapshot" :: held 1.435s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Created reservations ['64e6dd72-09a3-45b3-ba93-afe6c4f96a2a', 'd25cc9eb-c9d9-45b6-92fc-d8886e09c589', '9988b2f1-fdb1-4f2c-b172-4a0610ccae1d', 'ef5f8c68-597c-4d3f-90eb-1e03b8c545bf'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:02 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-9bd49e0a-33ed-47a6-8ea5-dbbc0392e31f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-7530c1d6-4ea6-4b54-ad9e-c5aa30cbdf52-delete_snapshot" released by "delete_snapshot" :: held 1.576s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-4fb3a304-e9de-47b3-a49f-b94f43a8da44-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "cinder-4fb3a304-e9de-47b3-a49f-b94f43a8da44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-quobyte-4fb3a304-e9de-47b3-a49f-b94f43a8da44" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:02 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-4fb3a304-e9de-47b3-a49f-b94f43a8da44" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[200af3dd-d4fb-4b6b-9143-17317b7e51fb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:03 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 Jul 28 14:48:03 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:03 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44" returned: 0 in 0.352s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-a726358b-32c0-471e-a31c-923922f0478f-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:03 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44 Jul 28 14:48:03 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-a726358b-32c0-471e-a31c-923922f0478f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" acquired by "delete_volume" :: waited 0.018s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60eef2-ac98-457e-ae0d-3279bb357efb]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:03 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f Jul 28 14:48:03 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:03 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-4fb3a304-e9de-47b3-a49f-b94f43a8da44" returned: 0 in 0.261s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-4fb3a304-e9de-47b3-a49f-b94f43a8da44" released by "delete_volume" :: held 0.653s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Created reservations ['742060a2-30e8-4dd1-930d-3be934bc0cff', '4d7fd52e-663e-4320-adbc-10f0d1eaf5b9', '4f36ba58-15ef-4e77-b298-00649f8fd8de', '985b9def-57bb-4ecf-ac61-fa3c10285ca1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:03 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:03 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:03 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f" returned: 0 in 0.388s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:03 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:03 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f Jul 28 14:48:03 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:04 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.270s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Deleted volume successfully. Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-11dd659d-5f70-4cd5-a6e5-c4a937acfb2e tempest-ProjectReaderTests-1934012501 None] Lock "cinder-4fb3a304-e9de-47b3-a49f-b94f43a8da44-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:04 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-a726358b-32c0-471e-a31c-923922f0478f" returned: 0 in 0.261s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-a726358b-32c0-471e-a31c-923922f0478f" released by "delete_volume" :: held 0.705s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Created reservations ['7587282f-d9ad-4edf-91e8-9c7cae67a842', 'ec0b3472-3e48-4b4f-90a9-a9c6ea42c789', 'd7dc0944-b57e-4d60-ad05-f029e0f9bda6', 'b37f062b-cb21-49ce-a61c-e19dd70a561a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:04 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:04 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:48:04 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (dc688051-e63a-4903-b201-57b576dd9e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1597d9-ccdf-4f0f-aeb0-f8aaa6ecb78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.296s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:04 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1597d9-ccdf-4f0f-aeb0-f8aaa6ecb78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496892258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5b50c-3e86-421e-b233-6e52c71ef5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:04Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce5c828-b70e-49ce-b711-2166a3e262f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce5c828-b70e-49ce-b711-2166a3e262f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb00f34-7b67-40bb-adb6-012da8fba782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb00f34-7b67-40bb-adb6-012da8fba782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a5b50c-3e86-421e-b233-6e52c71ef5db', 'volume_name': 'volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4299c59c-d167-4382-a0fb-9d0dc2cc3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4299c59c-d167-4382-a0fb-9d0dc2cc3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abedb5b9-3c5e-47d2-9ae0-b3fc84cf4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:04 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Volume d8a5b50c-3e86-421e-b233-6e52c71ef5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db', 'volume_size': 1} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496892258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5b50c-3e86-421e-b233-6e52c71ef5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77f0f8f0e144c089b65b1bec0c00425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:04Z,use_quota=True,user_id='2f7abc369c244abf9c798754d7308c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Creating volume d8a5b50c-3e86-421e-b233-6e52c71ef5db {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:48:04 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:04 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-1911a8ef-8edb-4d62-900a-50b4de4abe9c tempest-ProjectMemberTests-1414835863 None] Lock "cinder-a726358b-32c0-471e-a31c-923922f0478f-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:04 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db 1073741824 Jul 28 14:48:04 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (6fe89cd7-e977-4cc6-968c-94af06186b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def54b19-f757-4f6f-a86a-b7efde949457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def54b19-f757-4f6f-a86a-b7efde949457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-541342170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da33f70-ed27-4209-9d37-2051d036f384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:05Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f301bde-5910-40bb-bd0b-32398771f522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f301bde-5910-40bb-bd0b-32398771f522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1416d-7378-40ca-bbbc-dcbb8b10555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e1416d-7378-40ca-bbbc-dcbb8b10555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da33f70-ed27-4209-9d37-2051d036f384', 'volume_name': 'volume-7da33f70-ed27-4209-9d37-2051d036f384', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d81fed7-b2a7-44c8-bab9-bd22284b8fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d81fed7-b2a7-44c8-bab9-bd22284b8fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3cdb-df27-4676-a444-5fa329d9bcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Volume 7da33f70-ed27-4209-9d37-2051d036f384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da33f70-ed27-4209-9d37-2051d036f384', 'volume_size': 1} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db 1073741824" returned: 0 in 0.497s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:05 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db Jul 28 14:48:05 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:05 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-541342170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da33f70-ed27-4209-9d37-2051d036f384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:05Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Creating volume 7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:48:05 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abedb5b9-3c5e-47d2-9ae0-b3fc84cf4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8806c14-d892-4f0b-9e74-c72130585815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:05 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 1073741824 Jul 28 14:48:05 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:05 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Volume volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db (d8a5b50c-3e86-421e-b233-6e52c71ef5db): created successfully Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8806c14-d892-4f0b-9e74-c72130585815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Flow 'volume_create_manager' (dc688051-e63a-4903-b201-57b576dd9e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:05 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-e93c3f59-da8c-406b-9f2f-ff3c6f0c413c tempest-ProjectReaderTests-1934012501 None] Created volume successfully. Jul 28 14:48:05 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 1073741824" returned: 0 in 0.423s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:05 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:05 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 Jul 28 14:48:05 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:06 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3cdb-df27-4676-a444-5fa329d9bcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da33f70-ed27-4209-9d37-2051d036f384', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a486b55f-ded8-4fc4-aec7-830f7a96acff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:06 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Volume volume-7da33f70-ed27-4209-9d37-2051d036f384 (7da33f70-ed27-4209-9d37-2051d036f384): created successfully Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a486b55f-ded8-4fc4-aec7-830f7a96acff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (6fe89cd7-e977-4cc6-968c-94af06186b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:06 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-88968e63-b55a-4521-b5a7-c5d6d0353c2e tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-d8a5b50c-3e86-421e-b233-6e52c71ef5db-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-d8a5b50c-3e86-421e-b233-6e52c71ef5db-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "cinder-quobyte-d8a5b50c-3e86-421e-b233-6e52c71ef5db" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-d8a5b50c-3e86-421e-b233-6e52c71ef5db" acquired by "delete_volume" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb527c-341e-4422-9404-1ae857b6288c]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:06 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:06 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db Jul 28 14:48:06 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:07 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db" returned: 0 in 0.355s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:07 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db Jul 28 14:48:07 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 6856c8ef-04b0-4165-a50d-6e9f18208d1f of volume 7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ff606-1f43-44d7-8068-14a740a5e894]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:07 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-d8a5b50c-3e86-421e-b233-6e52c71ef5db" returned: 0 in 0.263s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-quobyte-d8a5b50c-3e86-421e-b233-6e52c71ef5db" released by "delete_volume" :: held 0.656s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Created reservations ['83086018-58ba-4501-817b-f27ddc4f1ae9', '5b5aa0c1-1302-497e-ae34-35d2967a0965', 'c8c1c565-15a3-4488-ac3a-5d0cfcfe045a', '90d3bb3a-8bc1-4c7c-a442-7f3d178fe169'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:07 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 Jul 28 14:48:07 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:07 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:07 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:07 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384" returned: 0 in 0.349s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:07 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f 1G Jul 28 14:48:07 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:07 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.259s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:07 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Deleted volume successfully. Jul 28 14:48:07 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-8516e81f-065b-4a6f-b8c2-d8910e979c16 tempest-ProjectReaderTests-1934012501 None] Lock "cinder-d8a5b50c-3e86-421e-b233-6e52c71ef5db-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:08 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f 1G" returned: 0 in 0.438s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da33f70-ed27-4209-9d37-2051d036f384 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:08 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da33f70-ed27-4209-9d37-2051d036f384 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f Jul 28 14:48:08 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:08 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da33f70-ed27-4209-9d37-2051d036f384 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f" returned: 0 in 0.288s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:08 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f is being set with open permissions: ugo+rw Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:08 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f Jul 28 14:48:08 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:08 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f" returned: 0 in 0.269s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:08 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info Jul 28 14:48:08 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:08 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info" returned: 0 in 0.268s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:08 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info is being set with open permissions: ugo+rw Jul 28 14:48:08 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:08 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info Jul 28 14:48:08 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:09 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.info" returned: 0 in 0.267s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:09 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-bbc2e3f5-902c-417f-99b3-019f7713aebe tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-6856c8ef-04b0-4165-a50d-6e9f18208d1f-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-6856c8ef-04b0-4165-a50d-6e9f18208d1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-6856c8ef-04b0-4165-a50d-6e9f18208d1f" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-6856c8ef-04b0-4165-a50d-6e9f18208d1f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 6856c8ef-04b0-4165-a50d-6e9f18208d1f of volume 7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df89a3-193f-49db-9b2a-b5d67d0316e6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:09 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f Jul 28 14:48:09 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:09 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f" returned: 0 in 0.376s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da33f70-ed27-4209-9d37-2051d036f384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[61085c5e-ca68-479b-a101-04b2f0e729e6]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:09 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:09 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 Jul 28 14:48:09 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:10 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384" returned: 0 in 0.346s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:10 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f Jul 28 14:48:10 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:10 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f" returned: 0 in 0.320s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:10 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f Jul 28 14:48:10 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:10 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384.6856c8ef-04b0-4165-a50d-6e9f18208d1f" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-6856c8ef-04b0-4165-a50d-6e9f18208d1f" released by "_delete_snapshot" :: held 1.382s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" released by "delete_snapshot" :: held 1.401s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Created reservations ['a6a2d5c5-1d4f-43e5-92ab-53c6e66b7082', 'c0064bd3-0128-4e72-bc46-7a6aef06bf01', '2921cd80-1de4-417e-be54-6f40f7b335c4', '9b83810f-b862-49ac-8a09-10bfc181cbb1'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:10 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:48:10 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-0287b731-91a4-4d7a-9963-1111a9f7678f tempest-ProjectMemberTests-1414835863 None] Lock "cinder-6856c8ef-04b0-4165-a50d-6e9f18208d1f-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-7da33f70-ed27-4209-9d37-2051d036f384-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "cinder-7da33f70-ed27-4209-9d37-2051d036f384-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b9f55-9ba9-4a5e-9d7e-e6c46b810482]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:11 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:11 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 Jul 28 14:48:11 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:12 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384" returned: 0 in 0.360s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:12 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384 Jul 28 14:48:12 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:12 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-7da33f70-ed27-4209-9d37-2051d036f384" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-7da33f70-ed27-4209-9d37-2051d036f384" released by "delete_volume" :: held 0.658s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Created reservations ['3934b7b3-a6e3-4c7e-9875-faacd8fcc1f0', 'e9727251-5eb8-4963-83be-52aed0f859cf', 'd7bcaee1-6b82-4484-8f22-6d1d8f1a6fd9', 'f5caac99-4266-4af6-8753-f27260304e38'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:12 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:12 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:12 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.250s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:12 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:48:12 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-00f1b924-a9ad-4bfd-9642-7d13b8babdba tempest-ProjectMemberTests-1414835863 None] Lock "cinder-7da33f70-ed27-4209-9d37-2051d036f384-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (8135b96d-eb72-47a0-a981-c7305e1b74a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a393781c-2906-4c8d-b30f-c3e41d1923fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a393781c-2906-4c8d-b30f-c3e41d1923fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134462383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b29c1d-c887-4920-b11f-832edf4dc013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:13Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6633ae-0551-42f5-b140-4144704f9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6633ae-0551-42f5-b140-4144704f9352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9a45e6-8451-4255-920d-be5d17c3cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9a45e6-8451-4255-920d-be5d17c3cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b29c1d-c887-4920-b11f-832edf4dc013', 'volume_name': 'volume-35b29c1d-c887-4920-b11f-832edf4dc013', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80868a39-a1b6-48c0-9eba-051856b20c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80868a39-a1b6-48c0-9eba-051856b20c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa0263f-d341-4b8d-9791-2f458284c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Volume 35b29c1d-c887-4920-b11f-832edf4dc013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b29c1d-c887-4920-b11f-832edf4dc013', 'volume_size': 1} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134462383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b29c1d-c887-4920-b11f-832edf4dc013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:13Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Creating volume 35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:48:13 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:13 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 1073741824 Jul 28 14:48:13 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:13 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 1073741824" returned: 0 in 0.412s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:13 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 Jul 28 14:48:13 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:13 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013" returned: 0 in 0.241s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa0263f-d341-4b8d-9791-2f458284c581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b29c1d-c887-4920-b11f-832edf4dc013', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddbd174-ad6e-429a-8cd8-fbe6f282ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:13 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Volume volume-35b29c1d-c887-4920-b11f-832edf4dc013 (35b29c1d-c887-4920-b11f-832edf4dc013): created successfully Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddbd174-ad6e-429a-8cd8-fbe6f282ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:13 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (8135b96d-eb72-47a0-a981-c7305e1b74a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:14 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-c37294bb-37d1-4dfe-bb9b-2cc0b9b67506 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot c5b18a23-aff7-442e-acff-fb271bafe584 of volume 35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8236a5-7ab3-4f44-85c7-af3654ef0982]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:14 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 Jul 28 14:48:14 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:14 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013" returned: 0 in 0.348s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:14 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:14 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 1G Jul 28 14:48:14 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:15 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 1G" returned: 0 in 0.379s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b29c1d-c887-4920-b11f-832edf4dc013 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:15 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b29c1d-c887-4920-b11f-832edf4dc013 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 Jul 28 14:48:15 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:15 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b29c1d-c887-4920-b11f-832edf4dc013 -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584" returned: 0 in 0.285s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:15 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 is being set with open permissions: ugo+rw Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:15 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 Jul 28 14:48:15 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:15 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584" returned: 0 in 0.244s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:15 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info Jul 28 14:48:15 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:15 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info" returned: 0 in 0.249s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:15 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info is being set with open permissions: ugo+rw Jul 28 14:48:15 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:15 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info Jul 28 14:48:15 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:16 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.info" returned: 0 in 0.240s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:16 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-3aa17dc5-85e7-406a-b5a4-b10439bdb61d tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-c5b18a23-aff7-442e-acff-fb271bafe584-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-c5b18a23-aff7-442e-acff-fb271bafe584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-c5b18a23-aff7-442e-acff-fb271bafe584" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-c5b18a23-aff7-442e-acff-fb271bafe584" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot c5b18a23-aff7-442e-acff-fb271bafe584 of volume 35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c1791-c2c2-4590-873f-2a985b54669f]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:16 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 Jul 28 14:48:16 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:16 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584" returned: 0 in 0.351s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b29c1d-c887-4920-b11f-832edf4dc013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da6e00b-d8df-4728-b7a5-cd9433e3410b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:16 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:17 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 Jul 28 14:48:17 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:17 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:17 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 Jul 28 14:48:17 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:17 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584" returned: 0 in 0.318s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:17 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584 Jul 28 14:48:17 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:17 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013.c5b18a23-aff7-442e-acff-fb271bafe584" returned: 0 in 0.238s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-c5b18a23-aff7-442e-acff-fb271bafe584" released by "_delete_snapshot" :: held 1.335s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" released by "delete_snapshot" :: held 1.355s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Created reservations ['e93e5225-b8ca-4393-a03b-d75437febc78', '1398a6f9-8df2-4f25-b2ef-d2282525d984', 'ef672822-5434-4dd3-a994-1c8fff715c50', '233ad9a0-453f-4e5d-9f1f-f377fb06190c'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:17 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:48:17 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-414b3ddd-2ea6-476f-a749-767dc1b32a1e tempest-ProjectMemberTests-1414835863 None] Lock "cinder-c5b18a23-aff7-442e-acff-fb271bafe584-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-35b29c1d-c887-4920-b11f-832edf4dc013-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-35b29c1d-c887-4920-b11f-832edf4dc013-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" acquired by "delete_volume" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c59a1-e054-46a1-ab59-bebc17b29345]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:18 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:18 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 Jul 28 14:48:18 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:19 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:19 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013 Jul 28 14:48:19 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:19 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-35b29c1d-c887-4920-b11f-832edf4dc013" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-35b29c1d-c887-4920-b11f-832edf4dc013" released by "delete_volume" :: held 0.668s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Created reservations ['3b6bd7cc-811f-4fcf-82c9-025d3b99f1a2', '0a859472-e6a4-404a-9071-f55b35524724', '8b4ae4be-f98a-488b-a7ff-516c1fccd25d', 'c753248d-3174-4998-b88b-68ab7503ce9a'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:19 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:19 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:19 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:19 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:48:19 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-b1af0a7c-dcba-4884-88fc-5d7201a95b55 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-35b29c1d-c887-4920-b11f-832edf4dc013-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87385) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (2cb3cca0-2c8e-41dd-8c54-da00e0681228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01f0a6b-55a0-4c45-8bd8-e49672920bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01f0a6b-55a0-4c45-8bd8-e49672920bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681809632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe33a619-9809-44ff-972d-abb003a35f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:20Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ae950b-b087-47ad-9eba-d78bf291a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ae950b-b087-47ad-9eba-d78bf291a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9cc623-7a03-487c-8656-f61b4da5bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9cc623-7a03-487c-8656-f61b4da5bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe33a619-9809-44ff-972d-abb003a35f7d', 'volume_name': 'volume-fe33a619-9809-44ff-972d-abb003a35f7d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b9ab8-bf95-4b46-bf45-58b60c6ecea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b9ab8-bf95-4b46-bf45-58b60c6ecea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d78eb3-858c-473e-bc81-5d82bff67bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:20 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Volume fe33a619-9809-44ff-972d-abb003a35f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe33a619-9809-44ff-972d-abb003a35f7d', 'volume_size': 1} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-28T12:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681809632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe33a619-9809-44ff-972d-abb003a35f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480eff9f7e88480b9aa894df8e4e62d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-28T12:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-28T12:48:20Z,use_quota=True,user_id='e549d40090314fe985d9fb846d21e913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5),volume_type_id=5f9d6bae-fbca-42f5-9078-d4ad6ce8d0b5)}" {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Creating volume fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Selected osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 as target Quobyte volume. {{(pid=87385) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 28 14:48:20 devstack cinder-volume[87385]: INFO cinder.volume.drivers.remotefs [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] casted to osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726 Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d 1073741824 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:20 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d 1073741824 Jul 28 14:48:20 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:20 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d 1073741824" returned: 0 in 0.428s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:20 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d Jul 28 14:48:20 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:20 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d" returned: 0 in 0.243s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'} {{(pid=87385) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d78eb3-858c-473e-bc81-5d82bff67bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe33a619-9809-44ff-972d-abb003a35f7d', 'volume_size': 1}' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:20 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a917965-03c6-4d7b-aff4-76748a3da39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 28 14:48:21 devstack cinder-volume[87385]: INFO cinder.volume.flows.manager.create_volume [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Volume volume-fe33a619-9809-44ff-972d-abb003a35f7d (fe33a619-9809-44ff-972d-abb003a35f7d): created successfully Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a917965-03c6-4d7b-aff4-76748a3da39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87385) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Flow 'volume_create_manager' (2cb3cca0-2c8e-41dd-8c54-da00e0681228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87385) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 28 14:48:21 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-90a79832-6b9d-45a0-9310-b20dd9780cc6 tempest-ProjectMemberTests-1414835863 None] Created volume successfully. Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Creating offline snapshot 2e14521d-bbbf-40f5-95b3-aac641e2ca4f of volume fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce227e3c-66e2-4555-b2dd-a3eef795b5c9]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:21 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d Jul 28 14:48:21 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:21 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d" returned: 0 in 0.342s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:21 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f 1G {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:21 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f 1G Jul 28 14:48:21 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:22 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f 1G" returned: 0 in 0.384s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe33a619-9809-44ff-972d-abb003a35f7d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:22 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe33a619-9809-44ff-972d-abb003a35f7d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f Jul 28 14:48:22 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:22 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe33a619-9809-44ff-972d-abb003a35f7d -F qcow2 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f" returned: 0 in 0.287s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:22 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f is being set with open permissions: ugo+rw Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:22 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f Jul 28 14:48:22 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:22 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f" returned: 0 in 0.231s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:22 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info Jul 28 14:48:22 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:22 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info" returned: 0 in 0.260s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:22 devstack cinder-volume[87385]: WARNING cinder.volume.drivers.remotefs [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info is being set with open permissions: ugo+rw Jul 28 14:48:22 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:22 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info Jul 28 14:48:22 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:23 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.info" returned: 0 in 0.245s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:23 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-2266893f-4187-4746-ba97-b5d9e6aff447 tempest-ProjectMemberTests-1414835863 None] Create snapshot completed successfully Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-2e14521d-bbbf-40f5-95b3-aac641e2ca4f-delete_snapshot" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2e14521d-bbbf-40f5-95b3-aac641e2ca4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" by "delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-2e14521d-bbbf-40f5-95b3-aac641e2ca4f" by "_delete_snapshot" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2e14521d-bbbf-40f5-95b3-aac641e2ca4f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Deleting offline snapshot 2e14521d-bbbf-40f5-95b3-aac641e2ca4f of volume fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] snapshot_file for this snap is: volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d76d58-8bef-471a-8d4d-ef58988520fd]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:23 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:23 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f Jul 28 14:48:23 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:24 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f" returned: 0 in 0.365s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.remotefs [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe33a619-9809-44ff-972d-abb003a35f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87385) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c49d51c-e411-48b2-a373-1072a5e8549b]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:24 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d Jul 28 14:48:24 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:24 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d" returned: 0 in 0.353s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:24 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f Jul 28 14:48:24 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:24 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f" returned: 0 in 0.334s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:24 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f Jul 28 14:48:24 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:24 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:24 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d.2e14521d-bbbf-40f5-95b3-aac641e2ca4f" returned: 0 in 0.245s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-2e14521d-bbbf-40f5-95b3-aac641e2ca4f" released by "_delete_snapshot" :: held 1.387s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" released by "delete_snapshot" :: held 1.407s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Created reservations ['1fd1cad7-e901-48a6-ae64-e92b6e86ac39', '459e4c28-8525-4b35-8349-d527bcc85e39', '5b3706e5-c28a-4e0e-a076-e26a58d18746', 'c85b7d79-c4b0-4d7e-a21f-94e8c36e561b'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:25 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Delete snapshot completed successfully. Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-f80264ab-361c-494e-9925-fd114af81494 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-2e14521d-bbbf-40f5-95b3-aac641e2ca4f-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-fe33a619-9809-44ff-972d-abb003a35f7d-delete_volume" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-fe33a619-9809-44ff-972d-abb003a35f7d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" by "delete_volume" {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" acquired by "delete_volume" :: waited 0.019s {{(pid=87385) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba976542-74c1-4b14-b78b-d31a3a14cca1]: (4, 'qcow2') {{(pid=89426) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 28 14:48:25 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:25 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d Jul 28 14:48:25 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:26 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d" returned: 0 in 0.362s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:26 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d Jul 28 14:48:26 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:26 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44/volume-fe33a619-9809-44ff-972d-abb003a35f7d" returned: 0 in 0.239s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-quobyte-fe33a619-9809-44ff-972d-abb003a35f7d" released by "delete_volume" :: held 0.658s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.quota [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Created reservations ['bd5b3e14-67c2-4dc2-9202-c72190ae07ad', '7bb550ea-c2b7-4269-8ef0-384206cf1da2', '44f8cf01-05e9-4f5f-a60d-457009d5a091', 'cbefaf18-a570-421e-a13c-2383084b3d5d'] {{(pid=87385) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:26 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:26 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:26 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:26 devstack cinder-volume[87385]: INFO cinder.volume.manager [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Deleted volume successfully. Jul 28 14:48:26 devstack cinder-volume[87385]: DEBUG cinder.coordination [None req-5fceb6df-9fc7-474b-b761-edd567d794c2 tempest-ProjectMemberTests-1414835863 None] Lock "cinder-fe33a619-9809-44ff-972d-abb003a35f7d-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87385) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 28 14:48:36 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:DELETE=11,cinder:UPDATE=117,cinder:SELECT=80,cinder:INSERT=34 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:48:36 devstack cinder-volume[87385]: DEBUG dbcounter [-] [87385] Writing DB stats cinder:UPDATE=138,cinder:SELECT=103,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726': None} {{(pid=87385) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG cinder.volume.drivers.quobyte [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87674ad3-ce00-4968-bf0e-adc009de4726'] {{(pid=87385) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.lockutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87385) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 28 14:48:49 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44 Jul 28 14:48:49 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 28 14:48:49 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_concurrency.processutils [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33188d080c9f8e8159cc05f3768a1a44" returned: 0 in 0.246s {{(pid=87385) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG cinder.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Notifying Schedulers of capabilities ... {{(pid=87385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG oslo_service.periodic_task [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] Running periodic task VolumeManager._thread_info {{(pid=87385) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread count: 29 {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 28 14:48:49 devstack cinder-volume[87385]: DEBUG cinder.volume.manager [None req-9a0d45e8-dc41-476f-9064-4d9b31e5f91c None None] thread info: [<_MainThread(MainThread, started 132738200637568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87385) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}